-- Logs begin at Mon 2022-02-28 21:01:33 UTC, end at Mon 2022-02-28 22:21:48 UTC. -- Feb 28 21:34:14.865608 dv-cinder-830901-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 28 21:34:14.874865 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 28 21:34:14 2022] *** Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: nodename: dv-cinder-830901-2-iscsi Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: machine: x86_64 Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: clock source: unix Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: pcre jit disabled Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: detected number of CPU cores: 4 Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: current working directory: / Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: detected binary path: /usr/bin/uwsgi-core Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: your processes number limit is 47680 Feb 28 21:34:14.877033 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: your memory page size is 4096 bytes Feb 28 21:34:14.877733 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: detected max file descriptor number: 2048 Feb 28 21:34:14.877733 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: lock engine: pthread robust mutexes Feb 28 21:34:14.877733 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: thunder lock: enabled Feb 28 21:34:14.877733 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 28 21:34:14.877733 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 28 21:34:14.922683 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: Python main interpreter initialized at 0x561271fba9c0 Feb 28 21:34:14.922683 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: python threads support enabled Feb 28 21:34:14.922683 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: your server socket listen backlog is limited to 100 connections Feb 28 21:34:14.922683 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: your mercy for graceful operations on workers is 90 seconds Feb 28 21:34:14.923039 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: mapped 403077 bytes (393 KB) for 2 cores Feb 28 21:34:14.923116 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: *** Operational MODE: preforking *** Feb 28 21:34:14.923364 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: *** uWSGI is running in multiple interpreter mode *** Feb 28 21:34:14.923364 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: spawned uWSGI master process (pid: 86272) Feb 28 21:34:14.923564 dv-cinder-830901-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 28 21:34:14.926480 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: spawned uWSGI worker 1 (pid: 86285, cores: 1) Feb 28 21:34:14.926480 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: spawned uWSGI worker 2 (pid: 86286, cores: 1) Feb 28 21:34:14.926480 dv-cinder-830901-2-iscsi devstack@keystone.service[86272]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 28 21:34:20.708789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 21:34:20.708789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: from cryptography.utils import int_from_bytes Feb 28 21:34:20.709589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 21:34:20.709589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: from cryptography.utils import int_from_bytes Feb 28 21:34:20.709936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 21:34:20.709936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: from cryptography.utils import int_from_bytes Feb 28 21:34:20.710424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 28 21:34:20.710424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: from cryptography.utils import int_from_bytes Feb 28 21:34:20.756447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 21:34:20.756627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 21:34:20.756804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] command line args: [] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 21:34:20.757068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 21:34:20.757242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ================================================================================ {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 21:34:20.757406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 28 21:34:20.757490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] admin_token = **** {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.757602 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 28 21:34:20.757723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] config_dir = [] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.757807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] command line args: [] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 28 21:34:20.757906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.758079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 28 21:34:20.758168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] config_source = [] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.758261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ================================================================================ {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 28 21:34:20.758348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] debug = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.758451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.758707 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] admin_token = **** {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.758769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] config_dir = [] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.758831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.758969 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.759077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.759180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] config_source = [] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.759281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.759377 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] debug = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.759487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.759591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.759716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] list_limit = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.759812 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.759905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] log_config_append = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.760012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.760119 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.760214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.760313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] log_dir = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.760313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] log_file = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.760495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.760595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.760711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] list_limit = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.760711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] log_config_append = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.760888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] log_dir = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] log_file = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761544 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761656 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.761949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.762040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.762749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.762844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.762972 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.763194 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.763644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.763768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.763888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.764014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.764134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.764252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.764371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.764484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.764598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.764775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.764907 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.765028 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.765147 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] publish_errors = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.765267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.765381 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.765498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.765609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.765722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.765840 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.765964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.766110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.766225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.766346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] standard_threads = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.766463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.766588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.766702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] publish_errors = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.766903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.767026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.767150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.767150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] use_journal = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.767369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.767482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] use_json = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.767594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.767706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] use_stderr = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.767832 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.767946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] use_syslog = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.768058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.768177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.768296 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] standard_threads = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.768416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.768538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.768651 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.768764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.768883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.769002 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.769116 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.769245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] use_journal = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.769245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] use_json = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.769471 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.769585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] use_stderr = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.769704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.769825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] use_syslog = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.769941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.770079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 28 21:34:20.770199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.770320 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.770439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.770562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.770682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.770795 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.770909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.771027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.771141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.771331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.771453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.771684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.771807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.771921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.772034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.772158 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.772278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.772399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.772518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.772637 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.772759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.772881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.772996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.773114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.773226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.773345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.773463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.773584 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.773704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.773818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.773936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.774076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.774198 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.774319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.774433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.774551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.774671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.774793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.774913 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.775035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.775150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.775262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.775380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.775498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.775612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.775612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.775821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.775933 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.776034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.776130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.776223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.776325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.776420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.776514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.776607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.776700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.776801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.776925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.777033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.777154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.777269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.777382 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.777503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.777617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.777730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.778464 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.778585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.778692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.778807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.778922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.779036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.779150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.779150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.779371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.779482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.779482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.779482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.779807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.779927 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.780041 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.780160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.780275 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.780397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.780508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.780627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.780742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.780856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.780975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.781096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.781211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.781330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.781436 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.781553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.781675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.781798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.781920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.782048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.782163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.782283 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.782405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.782527 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.782648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.782761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.782874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.782993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.783115 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.783230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.783350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.783472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.783588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.783700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.783814 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.783997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.784114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.784227 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.784340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.784453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.784575 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.784690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.784807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.784926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.785041 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.785154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.785275 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.785396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.785510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.785625 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.785747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.785861 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.785983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.786123 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.786247 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.786363 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.786476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.786598 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.786723 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.786849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.786973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.787089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.787203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.787316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.787316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.787538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.787661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.787777 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.787890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.788004 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.788117 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.788231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.788356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.788472 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.788585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.788699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.788813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.788934 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.789057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.789173 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.789293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.789423 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.789539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.789653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.789779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.789901 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.790063 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.790182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.790296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.790409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.790535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.790650 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.790764 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.790921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.791039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.791153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.791275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.791390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.791505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.791618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.791731 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.791845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.791967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.792088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.792203 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.792317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.792430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.792543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.792665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.792780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.792894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.793008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.793122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] auth.external = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.793235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.793357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.793514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.793662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.793806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.793976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.794121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.794250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] auth.password = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.794367 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.794482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] auth.token = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.794596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.794713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.794836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.794952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.795067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.795180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.795322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.795447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.795564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.795678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.795794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.795917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.795917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.796141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.796255 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] credential.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.796461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] auth.external = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.796461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.796689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.796689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.796917 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.797033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.797159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.797348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.797472 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] auth.password = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.797586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.797700 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] auth.token = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.797812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.797926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.798080 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.798201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.798316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.798431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.798546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.798661 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.798783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.798900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.798900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.799129 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.799245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.799359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.799481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] credential.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.799596 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.799710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.799824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.799937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.800051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.800174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.800290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] federation.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.800404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.800518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.800631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.800745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.800867 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.800990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.800990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.801212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.801328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.801442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.801563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.801678 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.801792 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.801906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.802033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.802150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.802276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.802394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.802509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.802623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.802737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.802851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.802973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.803089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.803204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.803319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] federation.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.803440 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.803562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.803686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.803803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.803917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.804032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.804145 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.804259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.804381 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.804381 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.804598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.804718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.804832 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.804945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.805067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.805183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.805297 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.805411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.805526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.805640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.805762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.805877 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.806005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.806122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.806237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.806366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.806483 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.806598 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.806714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.806836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.806952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.807075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.807190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.807304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.807418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.807531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.807653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.807777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.807893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.808006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.808006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.808220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.808339 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.808462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.808577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.808692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.808806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.808930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.809045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.809188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.809327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.809444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.809558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.809680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.809796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.809919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.810042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.810159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.810274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.810274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.810274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.810600 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.810717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.810833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.810947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.811067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.811182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.811182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.811413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.811535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.811650 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.811764 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.811879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.812000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.812117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.812117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.812337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.812337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.812552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.812677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.812793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.812908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.813022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.813135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.813255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.813378 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.813499 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.813614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.813728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.813842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.813957 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.814605 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.814714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.814811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.814908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.815004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.815109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.815216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.815314 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.815411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.815508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.815604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.815701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.815806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.815904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816791 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.816998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.817097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.817192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.817294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.817391 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.817486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.817590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.817688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.817789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.817886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.817981 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.818117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.818222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.818318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.818413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.818508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.818610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.818714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.818812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.818812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.818989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.819091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.819212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.819402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.819521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.819636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.819751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.819866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.819981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.820103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.820220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.820335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.820455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.820570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.820684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.820810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.820926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.821041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.821155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.821270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.821385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.821508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.821624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.821738 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.821852 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.821966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.822095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.822222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.822340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.822455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.822568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.822681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] resource.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.822795 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.822917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.823033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.823148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.823261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.823376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.823490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.823611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.823727 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.823842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.823956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.824070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.824184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.824307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.824425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.824539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.825164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.825333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.825444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.825567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] role.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.825684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.825799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] role.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.825913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.826081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.826200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.826328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.826328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.826328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.826648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.826753 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.826866 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.826988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.827105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.827219 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.827334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.827448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.827564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.827686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.827801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.827915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.828029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] resource.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.828143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.828257 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.828380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.828496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.828611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.828725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.828839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.828953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.828953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.829180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.829295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.829409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.829523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.829646 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.829763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.829884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.830012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.830129 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.830243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] role.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.830369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.830487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] role.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.830601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.830717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.830831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.830946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.831068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.831184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.831299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.831414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.831528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.831528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.831752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.831869 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.831983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.832097 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.832211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.832325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.832453 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.832570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.832684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.832800 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.832914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.833028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.833149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.833265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.833378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.833493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] token.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.833606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.833720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.833844 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.833960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.833960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.834229 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.834343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.834457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.834586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.834704 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.834819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.834935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.835048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.835163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.835285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.835401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.835515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.835629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.835743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.835857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.835981 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.836096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.836210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.836324 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.836438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.836560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.836676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.836790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.836953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.837069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.837182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.837304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.837419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.837533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.837646 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.connection = **** {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.837768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.837891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.838021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.838135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.838262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.838377 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.838491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.838603 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.838716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] token.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.838829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.838952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.839067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.839181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.839293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.839407 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.839519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.839640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.839761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.839882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.839996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.840110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.840222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.840222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.841124 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.841239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.841353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.841466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.841578 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.841700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.841700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.841922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.842084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.842084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.842302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.842428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 21:34:20.842545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.842545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.842545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.842856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.843027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.843326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.843591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.connection = **** {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.843841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.844095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.844338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.844587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.844829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.845070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.845316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.845557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.845811 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.846079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.846328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.846569 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.846819 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.847058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.847304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.847537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.847782 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.848023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 28 21:34:20.848194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 28 21:34:20.872739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.872966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.873191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.875584 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.875824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.876054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.881693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.884574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.911446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.911672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.913289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.913528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.971310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:20.971465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.021303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.021534 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.023506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.023748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.087280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.087505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.087725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.087941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.088022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.088154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.088243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.088366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.088450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.088601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.088822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.089051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.113077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.113318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.113514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.113734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.113954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.114094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.114177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.114331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.114411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.114552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.114769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.114988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.115198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.115411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.125649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.126574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.138501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.138735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.138951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.139169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.139384 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.139527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.139608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.139763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.139843 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.139990 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.140214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.140457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.140694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.140914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 28 21:34:21.157190 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.157396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 21:34:21.157729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.157925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 21:34:21.158171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.158258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.158387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 21:34:21.158470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.158695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.158775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.158912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 28 21:34:21.158991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.159357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.159620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.159882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.160142 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.169566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.169835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.170118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.170401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.171369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.171648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.171917 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.172199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.178300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.180202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.181497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.181774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.182189 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.182468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.182748 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.183005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.183271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.183543 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.183624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.183809 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.183890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.184604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.184867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.185077 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.185332 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.185616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.185876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.186172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.186445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.186714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.186986 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.187257 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.211015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.212591 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.212864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.214187 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.216798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.217073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.218659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.218935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.219207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.222352 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.222591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.222874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.226303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.226579 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.230206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.230490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.231228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.231516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.231793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.232068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.232341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.232611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.232875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.233138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.235443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.235730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.236010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.236292 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.236574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.236851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.237121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.237388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.251845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.252120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.256531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.256716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.256994 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.260103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.260392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.261515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.265629 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.265895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.266219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.269282 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.271325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.272884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.273177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.273456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.273734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.274026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.274311 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.274894 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.279567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.279864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.280146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.280434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.280718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.280998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.293593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.293871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.294162 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.294441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.300350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.300634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.300900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.301269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.302075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.303732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.304003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.306975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.307256 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.307530 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.307805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.308088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.310140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.311841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.312119 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.315133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.315430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.315828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.316111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.316404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.321982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.322279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.322554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.322829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.323108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.323378 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.323647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.330014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.330288 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.330573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.330855 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.331142 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.331426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.331716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.343087 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.346300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.349487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.350406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.351067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.352654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.352929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.353207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.353634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.357863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.359547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.362655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.362942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.363227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.370673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.373445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.376767 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.377072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.377375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.377652 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.461805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.463461 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.467306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.467600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.467882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.468155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.477330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.477558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.477837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.485645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.485917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.486213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.486478 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.486803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.487076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.487364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.487627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.487888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.488257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.488529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.488788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.489055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.489319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.489398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.489649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.489936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.498692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 28 21:34:21.498973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.499255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.499532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.499806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.500078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.500374 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.500807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.501084 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.501357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.501638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.501902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.502202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.502472 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 28 21:34:21.527161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561271fba9c0 pid: 86286 (default app) Feb 28 21:34:21.530713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b5274-fe11-45d9-b500-1792f5ec0358 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:21.531003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b5274-fe11-45d9-b500-1792f5ec0358 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:21.531275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b5274-fe11-45d9-b500-1792f5ec0358 None None] PATH_INFO: `/v3` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:21.535441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Mon Feb 28 21:34:21 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:21.541076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561271fba9c0 pid: 86285 (default app) Feb 28 21:34:30.606754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65c58-68af-4f0c-b93d-c3b5eea05994 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:30.607268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65c58-68af-4f0c-b93d-c3b5eea05994 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:30.607268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d65c58-68af-4f0c-b93d-c3b5eea05994 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:30.609326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:34:30.616783 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34ea27-dc1c-4983-a282-b97769b36dd9 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:30.617182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34ea27-dc1c-4983-a282-b97769b36dd9 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:30.617346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34ea27-dc1c-4983-a282-b97769b36dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:30.647553 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG oslo_db.sqlalchemy.engines [None req-9a34ea27-dc1c-4983-a282-b97769b36dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 21:34:30.829674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG passlib.handlers.bcrypt [None req-9a34ea27-dc1c-4983-a282-b97769b36dd9 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86285) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 28 21:34:30.830123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG passlib.handlers.bcrypt [None req-9a34ea27-dc1c-4983-a282-b97769b36dd9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86285) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 28 21:34:30.886009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9a34ea27-dc1c-4983-a282-b97769b36dd9 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:30.888458 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9a34ea27-dc1c-4983-a282-b97769b36dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:31.009724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1/3] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 28 21:34:31.044464 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65c58-68af-4f0c-b93d-c3b5eea05994 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:31.081280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG oslo_db.sqlalchemy.engines [None req-83d65c58-68af-4f0c-b93d-c3b5eea05994 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 28 21:34:31.206692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d65c58-68af-4f0c-b93d-c3b5eea05994 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:31.210811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd412af-e07f-49b6-aa41-d1edec6b93ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:31.211451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd412af-e07f-49b6-aa41-d1edec6b93ef admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:31.211727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd412af-e07f-49b6-aa41-d1edec6b93ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:31.211996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd412af-e07f-49b6-aa41-d1edec6b93ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:31.221566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd412af-e07f-49b6-aa41-d1edec6b93ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:31.271932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8bd412af-e07f-49b6-aa41-d1edec6b93ef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 21:34:31.272264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd412af-e07f-49b6-aa41-d1edec6b93ef admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:31.281595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Feb 28 21:34:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 28 21:34:31.287577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34ea27-dc1c-4983-a282-b97769b36dd9 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:31.302529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34ea27-dc1c-4983-a282-b97769b36dd9 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:31.306915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523f67a-31d2-4d3f-a1e4-85f960321a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:31.308021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523f67a-31d2-4d3f-a1e4-85f960321a5f admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:31.308304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523f67a-31d2-4d3f-a1e4-85f960321a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:31.309334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523f67a-31d2-4d3f-a1e4-85f960321a5f admin admin] PATH_INFO: `/v3/projects/7297e55969ab4bf0b026f4e20d2cae80` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:31.310979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523f67a-31d2-4d3f-a1e4-85f960321a5f admin admin] RBAC: Authorizing `identity:get_project(project_id=7297e55969ab4bf0b026f4e20d2cae80)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:31.362382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b523f67a-31d2-4d3f-a1e4-85f960321a5f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 28 21:34:31.362719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523f67a-31d2-4d3f-a1e4-85f960321a5f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:31.367249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 2/5] 10.222.0.26 () {56 vars in 1207 bytes} [Mon Feb 28 21:34:31 2022] GET /identity/v3/projects/7297e55969ab4bf0b026f4e20d2cae80 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:33.630915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae73276-e4b5-48fe-8487-1396b295e759 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:33.631429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae73276-e4b5-48fe-8487-1396b295e759 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:33.631429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae73276-e4b5-48fe-8487-1396b295e759 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:33.635995 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 4/6] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:34:33.641721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ad4d5-74df-45c9-93e0-4b1477f01425 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:33.642133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ad4d5-74df-45c9-93e0-4b1477f01425 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:33.642309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ad4d5-74df-45c9-93e0-4b1477f01425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:33.661252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f57ad4d5-74df-45c9-93e0-4b1477f01425 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:33.662803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f57ad4d5-74df-45c9-93e0-4b1477f01425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:33.671614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 28 21:34:33.694840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae73276-e4b5-48fe-8487-1396b295e759 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:33.707041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae73276-e4b5-48fe-8487-1396b295e759 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:33.711210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3fbc9-1dae-4a09-adec-fc94279e7a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:33.711834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3fbc9-1dae-4a09-adec-fc94279e7a0e admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:33.712110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3fbc9-1dae-4a09-adec-fc94279e7a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:33.712380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3fbc9-1dae-4a09-adec-fc94279e7a0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:33.719998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3fbc9-1dae-4a09-adec-fc94279e7a0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:33.721750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3fbc9-1dae-4a09-adec-fc94279e7a0e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:33.730703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1324 bytes} [Mon Feb 28 21:34:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 21:34:33.735957 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ad4d5-74df-45c9-93e0-4b1477f01425 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:33.744966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ad4d5-74df-45c9-93e0-4b1477f01425 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:33.750094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6d81d-9d41-422e-ad36-5f92b56c510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:33.750956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6d81d-9d41-422e-ad36-5f92b56c510f admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:33.751238 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6d81d-9d41-422e-ad36-5f92b56c510f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:33.751513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6d81d-9d41-422e-ad36-5f92b56c510f admin admin] PATH_INFO: `/v3/users/3a718f2072b24450a97264ccf1958236` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:33.752912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6d81d-9d41-422e-ad36-5f92b56c510f admin admin] RBAC: Authorizing `identity:get_user(user_id=3a718f2072b24450a97264ccf1958236)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:33.754794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6d81d-9d41-422e-ad36-5f92b56c510f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:33.756349 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 4/9] 10.222.0.26 () {56 vars in 1198 bytes} [Mon Feb 28 21:34:33 2022] GET /identity/v3/users/3a718f2072b24450a97264ccf1958236 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:36.105918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24ad2-971e-4bb1-84c9-11f3c359f12c None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.106429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24ad2-971e-4bb1-84c9-11f3c359f12c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.106429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24ad2-971e-4bb1-84c9-11f3c359f12c None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.108327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:36.113415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203278b0-06e0-4480-92a7-498030fa93f8 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.113792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203278b0-06e0-4480-92a7-498030fa93f8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.114126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203278b0-06e0-4480-92a7-498030fa93f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.131314 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-203278b0-06e0-4480-92a7-498030fa93f8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:36.132486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-203278b0-06e0-4480-92a7-498030fa93f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:36.149428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a462a3f-54d7-45ed-a343-473377562422 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.149717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a462a3f-54d7-45ed-a343-473377562422 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.150023 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a462a3f-54d7-45ed-a343-473377562422 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.151730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 7/11] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:34:36.157381 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280c099-156f-43dd-9a5d-a9015b8fdd79 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.157734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280c099-156f-43dd-9a5d-a9015b8fdd79 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.158030 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280c099-156f-43dd-9a5d-a9015b8fdd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.199466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG passlib.handlers.bcrypt [None req-d280c099-156f-43dd-9a5d-a9015b8fdd79 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86286) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 28 21:34:36.199891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG passlib.handlers.bcrypt [None req-d280c099-156f-43dd-9a5d-a9015b8fdd79 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86286) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 28 21:34:36.211117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 5/12] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:36.235218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203278b0-06e0-4480-92a7-498030fa93f8 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:36.248299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d280c099-156f-43dd-9a5d-a9015b8fdd79 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:36.249875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d280c099-156f-43dd-9a5d-a9015b8fdd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:36.332634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203278b0-06e0-4480-92a7-498030fa93f8 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:36.346012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 8/13] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:34:36.364870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2b9f0-4a44-4351-bb71-346c5a0bd639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:36.365608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b9f0-4a44-4351-bb71-346c5a0bd639 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.365885 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b9f0-4a44-4351-bb71-346c5a0bd639 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.366184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b9f0-4a44-4351-bb71-346c5a0bd639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.368079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280c099-156f-43dd-9a5d-a9015b8fdd79 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:36.377025 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2b9f0-4a44-4351-bb71-346c5a0bd639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:36.383994 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-76b2b9f0-4a44-4351-bb71-346c5a0bd639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:34:36.385198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 6/14] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:34:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:34:36.391106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2b9f0-4a44-4351-bb71-346c5a0bd639 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:36.462585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280c099-156f-43dd-9a5d-a9015b8fdd79 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:36.483826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2b9f0-4a44-4351-bb71-346c5a0bd639 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:36.495089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b2a5e-8e46-47f0-afe0-0c5197b86109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:36.496095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b2a5e-8e46-47f0-afe0-0c5197b86109 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.496545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b2a5e-8e46-47f0-afe0-0c5197b86109 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.496826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b2a5e-8e46-47f0-afe0-0c5197b86109 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.516058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91371ce6-69dd-462f-9c08-af2d66097282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:36.516709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91371ce6-69dd-462f-9c08-af2d66097282 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.516988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91371ce6-69dd-462f-9c08-af2d66097282 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.517258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91371ce6-69dd-462f-9c08-af2d66097282 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.518013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91371ce6-69dd-462f-9c08-af2d66097282 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:36.518325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91371ce6-69dd-462f-9c08-af2d66097282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:36.519706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91371ce6-69dd-462f-9c08-af2d66097282 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:36.532755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 7/15] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:36.538175 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91371ce6-69dd-462f-9c08-af2d66097282 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:36.563047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b2a5e-8e46-47f0-afe0-0c5197b86109 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:36.564559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b2a5e-8e46-47f0-afe0-0c5197b86109 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:36.628779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91371ce6-69dd-462f-9c08-af2d66097282 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:36.657902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 9/16] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 21:34:36.662937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45810f15-b83c-4be6-b740-4b8b8b9f5eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:36.663182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b2a5e-8e46-47f0-afe0-0c5197b86109 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:36.663805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45810f15-b83c-4be6-b740-4b8b8b9f5eb7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.664084 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45810f15-b83c-4be6-b740-4b8b8b9f5eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.664352 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45810f15-b83c-4be6-b740-4b8b8b9f5eb7 None admin] PATH_INFO: `/v3/users/3a718f2072b24450a97264ccf1958236` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.665561 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45810f15-b83c-4be6-b740-4b8b8b9f5eb7 None admin] RBAC: Authorizing `identity:get_user(user_id=3a718f2072b24450a97264ccf1958236)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:36.667022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45810f15-b83c-4be6-b740-4b8b8b9f5eb7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:36.669134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 8/17] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:36 2022] GET /identity/v3/users/3a718f2072b24450a97264ccf1958236 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:36.674224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45810f15-b83c-4be6-b740-4b8b8b9f5eb7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:36.756807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b2a5e-8e46-47f0-afe0-0c5197b86109 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:36.767911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45810f15-b83c-4be6-b740-4b8b8b9f5eb7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:36.789394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d609041-9d0b-4f31-826a-4b21d21664d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:36.790210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d609041-9d0b-4f31-826a-4b21d21664d6 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.790485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d609041-9d0b-4f31-826a-4b21d21664d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.790756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d609041-9d0b-4f31-826a-4b21d21664d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.799909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58043dce-a5b3-4cdf-aa0c-1839721f70d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:36.800694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58043dce-a5b3-4cdf-aa0c-1839721f70d6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.800976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58043dce-a5b3-4cdf-aa0c-1839721f70d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.801253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58043dce-a5b3-4cdf-aa0c-1839721f70d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.802454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58043dce-a5b3-4cdf-aa0c-1839721f70d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:36.803892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58043dce-a5b3-4cdf-aa0c-1839721f70d6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:36.805474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:36.808772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d609041-9d0b-4f31-826a-4b21d21664d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:36.810243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d609041-9d0b-4f31-826a-4b21d21664d6 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:36.811271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58043dce-a5b3-4cdf-aa0c-1839721f70d6 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:36.828451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-9d609041-9d0b-4f31-826a-4b21d21664d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:34:36.829650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:34:36.835220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d609041-9d0b-4f31-826a-4b21d21664d6 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:36.906197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58043dce-a5b3-4cdf-aa0c-1839721f70d6 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:36.932345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d609041-9d0b-4f31-826a-4b21d21664d6 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:36.938870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d8cf1-f828-42c8-aec6-a0517c9f0cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:36.939533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8cf1-f828-42c8-aec6-a0517c9f0cb2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.939811 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8cf1-f828-42c8-aec6-a0517c9f0cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.940085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8cf1-f828-42c8-aec6-a0517c9f0cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.940911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d8cf1-f828-42c8-aec6-a0517c9f0cb2 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.domain.id=default, user.id=3a718f2072b24450a97264ccf1958236) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:36.941218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d8cf1-f828-42c8-aec6-a0517c9f0cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:36.942695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d8cf1-f828-42c8-aec6-a0517c9f0cb2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:36.949517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Feb 28 21:34:36 2022] GET /identity/v3/role_assignments?user.id=3a718f2072b24450a97264ccf1958236&scope.domain.id=default&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:36.965531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bcc92-d6aa-45fa-981e-3eff43ea3e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:36.966415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bcc92-d6aa-45fa-981e-3eff43ea3e76 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:36.966700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bcc92-d6aa-45fa-981e-3eff43ea3e76 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:36.966977 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bcc92-d6aa-45fa-981e-3eff43ea3e76 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:36.967766 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bcc92-d6aa-45fa-981e-3eff43ea3e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:36.968076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bcc92-d6aa-45fa-981e-3eff43ea3e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:36.969522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bcc92-d6aa-45fa-981e-3eff43ea3e76 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:36.989823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 11/21] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:39.976929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a22cb0-5a30-45b2-bcac-4c3f74ec1b2a None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:39.977768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a22cb0-5a30-45b2-bcac-4c3f74ec1b2a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:39.978249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a22cb0-5a30-45b2-bcac-4c3f74ec1b2a None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:39.980830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:39.986681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844bffb-1058-4df9-9596-f2d76f153584 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:39.987424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844bffb-1058-4df9-9596-f2d76f153584 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:39.987854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844bffb-1058-4df9-9596-f2d76f153584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.011350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-8844bffb-1058-4df9-9596-f2d76f153584 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:40.013028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-8844bffb-1058-4df9-9596-f2d76f153584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:40.107375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:34:40.125627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8653bc-4e6d-42a9-a431-2b1cf0cc2b2f None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.126184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8653bc-4e6d-42a9-a431-2b1cf0cc2b2f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.126643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8653bc-4e6d-42a9-a431-2b1cf0cc2b2f None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.128566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:40.133976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495d72c-f9e7-4bcb-a146-c13204ec4000 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.134458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495d72c-f9e7-4bcb-a146-c13204ec4000 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.134878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495d72c-f9e7-4bcb-a146-c13204ec4000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.150194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8653bc-4e6d-42a9-a431-2b1cf0cc2b2f None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:40.181785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d495d72c-f9e7-4bcb-a146-c13204ec4000 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:40.185136 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d495d72c-f9e7-4bcb-a146-c13204ec4000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:40.333903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:40.353856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8653bc-4e6d-42a9-a431-2b1cf0cc2b2f None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:40.368560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5dcb-4b34-4d03-b11c-eb93275cea48 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.368817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5dcb-4b34-4d03-b11c-eb93275cea48 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.369042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5dcb-4b34-4d03-b11c-eb93275cea48 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.370945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 14/26] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:34:40.376246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617648-82c1-43d8-8ec8-5d1b68a66608 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.376562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617648-82c1-43d8-8ec8-5d1b68a66608 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.376800 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3617648-82c1-43d8-8ec8-5d1b68a66608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.397863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-c3617648-82c1-43d8-8ec8-5d1b68a66608 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:40.399325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c3617648-82c1-43d8-8ec8-5d1b68a66608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:40.413769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a17fa-c645-4ed3-907b-a2922a75d48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:40.415066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a17fa-c645-4ed3-907b-a2922a75d48a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.415454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a17fa-c645-4ed3-907b-a2922a75d48a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.415735 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a17fa-c645-4ed3-907b-a2922a75d48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.428560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a17fa-c645-4ed3-907b-a2922a75d48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:40.430117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a17fa-c645-4ed3-907b-a2922a75d48a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:40.452426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-359a17fa-c645-4ed3-907b-a2922a75d48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:34:40.454147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 13/27] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:34:40.455552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a17fa-c645-4ed3-907b-a2922a75d48a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:40.471216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 15/28] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:34:40.472862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e4ae-a36e-4648-af0b-a2f9e8aa4cf8 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.473289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e4ae-a36e-4648-af0b-a2f9e8aa4cf8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.473727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70e4ae-a36e-4648-af0b-a2f9e8aa4cf8 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.475842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 16/29] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:40.480645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e4ae-a36e-4648-af0b-a2f9e8aa4cf8 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:40.556340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a17fa-c645-4ed3-907b-a2922a75d48a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:40.598037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70e4ae-a36e-4648-af0b-a2f9e8aa4cf8 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:40.598974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba78651-ac2c-457d-98a2-f6d2700eb9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:40.599787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78651-ac2c-457d-98a2-f6d2700eb9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.600065 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78651-ac2c-457d-98a2-f6d2700eb9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.600334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78651-ac2c-457d-98a2-f6d2700eb9c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.617728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba78651-ac2c-457d-98a2-f6d2700eb9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:40.627904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-2ba78651-ac2c-457d-98a2-f6d2700eb9c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:34:40.629888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 14/30] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:34:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:34:40.631968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1e388-2384-4d12-8719-f73fcff5d3f5 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.632399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1e388-2384-4d12-8719-f73fcff5d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.632826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1e388-2384-4d12-8719-f73fcff5d3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.635980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614b10-0516-4065-accc-16c7f1c76de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:40.637274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614b10-0516-4065-accc-16c7f1c76de5 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.638123 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614b10-0516-4065-accc-16c7f1c76de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.638535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614b10-0516-4065-accc-16c7f1c76de5 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.639407 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30614b10-0516-4065-accc-16c7f1c76de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:40.639709 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30614b10-0516-4065-accc-16c7f1c76de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:40.641106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30614b10-0516-4065-accc-16c7f1c76de5 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:40.653371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 17/31] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:40.654421 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614b10-0516-4065-accc-16c7f1c76de5 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:40.659341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-74d1e388-2384-4d12-8719-f73fcff5d3f5 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:40.660643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-74d1e388-2384-4d12-8719-f73fcff5d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:40.733013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 15/32] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:40.734327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1e388-2384-4d12-8719-f73fcff5d3f5 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:40.773473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614b10-0516-4065-accc-16c7f1c76de5 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:40.808497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465a890-6a92-4140-9c4e-e0bf9837b45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:40.809752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465a890-6a92-4140-9c4e-e0bf9837b45a None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.810254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465a890-6a92-4140-9c4e-e0bf9837b45a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.810712 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465a890-6a92-4140-9c4e-e0bf9837b45a None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.811680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465a890-6a92-4140-9c4e-e0bf9837b45a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:40.813307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465a890-6a92-4140-9c4e-e0bf9837b45a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:40.864401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1e388-2384-4d12-8719-f73fcff5d3f5 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:40.903187 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8daa19-426e-41e9-8d1a-5b8f4ffb22b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:40.903936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8daa19-426e-41e9-8d1a-5b8f4ffb22b9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:40.904223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8daa19-426e-41e9-8d1a-5b8f4ffb22b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:40.904503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8daa19-426e-41e9-8d1a-5b8f4ffb22b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:40.905269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8daa19-426e-41e9-8d1a-5b8f4ffb22b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:40.905577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8daa19-426e-41e9-8d1a-5b8f4ffb22b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:40.907005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8daa19-426e-41e9-8d1a-5b8f4ffb22b9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:40.920491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 16/33] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:40.920491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8daa19-426e-41e9-8d1a-5b8f4ffb22b9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:41.029979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8daa19-426e-41e9-8d1a-5b8f4ffb22b9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:41.046403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 18/34] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Feb 28 21:34:40 2022] POST /identity/v3/roles => generated 219 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:34:41.047508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465a890-6a92-4140-9c4e-e0bf9837b45a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:41.071601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1037b-05d8-4f67-a3e6-f59caef4fcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:41.073190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1037b-05d8-4f67-a3e6-f59caef4fcd6 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.073765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1037b-05d8-4f67-a3e6-f59caef4fcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.074875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1037b-05d8-4f67-a3e6-f59caef4fcd6 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.075859 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1037b-05d8-4f67-a3e6-f59caef4fcd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:41.078217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1037b-05d8-4f67-a3e6-f59caef4fcd6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:41.228446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465a890-6a92-4140-9c4e-e0bf9837b45a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:41.268409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46275f-beac-4234-b8be-208472a54126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:41.269094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46275f-beac-4234-b8be-208472a54126 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.269401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46275f-beac-4234-b8be-208472a54126 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.269660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46275f-beac-4234-b8be-208472a54126 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.270451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46275f-beac-4234-b8be-208472a54126 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:41.271962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46275f-beac-4234-b8be-208472a54126 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:41.300188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 17/35] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:34:40 2022] POST /identity/v3/projects => generated 301 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:34:41.301180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1037b-05d8-4f67-a3e6-f59caef4fcd6 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:41.339878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 19/36] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Feb 28 21:34:41 2022] POST /identity/v3/roles => generated 225 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:34:41.341787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571bb68-528d-4067-90e3-9abdb7e9e2d9 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.341787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571bb68-528d-4067-90e3-9abdb7e9e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.341787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571bb68-528d-4067-90e3-9abdb7e9e2d9 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.343609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 20/37] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:41.346092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2410c-c7c4-47fc-a942-0e7f3cb42f94 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.346092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2410c-c7c4-47fc-a942-0e7f3cb42f94 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.346092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2410c-c7c4-47fc-a942-0e7f3cb42f94 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.352000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 21/38] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:41.353498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7520dd4-9474-4d4b-944b-f0f739a05526 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.353783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7520dd4-9474-4d4b-944b-f0f739a05526 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.354087 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7520dd4-9474-4d4b-944b-f0f739a05526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.374062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d7520dd4-9474-4d4b-944b-f0f739a05526 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:41.375726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d7520dd4-9474-4d4b-944b-f0f739a05526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:41.449104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1037b-05d8-4f67-a3e6-f59caef4fcd6 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:41.458019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 22/39] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:41.458019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b9ce-9526-4ec4-962f-a3754b1cc291 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.458019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b9ce-9526-4ec4-962f-a3754b1cc291 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.458019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79b9ce-9526-4ec4-962f-a3754b1cc291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.486732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2f79b9ce-9526-4ec4-962f-a3754b1cc291 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:41.488243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2f79b9ce-9526-4ec4-962f-a3754b1cc291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:41.514634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eb3e6-fec4-48e2-9da2-51230018aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:41.516304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eb3e6-fec4-48e2-9da2-51230018aa1a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.517032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eb3e6-fec4-48e2-9da2-51230018aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.517461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eb3e6-fec4-48e2-9da2-51230018aa1a None admin] PATH_INFO: `/v3/users/3a718f2072b24450a97264ccf1958236` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.519349 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46eb3e6-fec4-48e2-9da2-51230018aa1a None admin] RBAC: Authorizing `identity:get_user(user_id=3a718f2072b24450a97264ccf1958236)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:41.521200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46eb3e6-fec4-48e2-9da2-51230018aa1a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:41.523297 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 18/40] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:41 2022] GET /identity/v3/users/3a718f2072b24450a97264ccf1958236 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:41.526032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eb3e6-fec4-48e2-9da2-51230018aa1a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:41.583411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 23/41] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:41.584337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79b9ce-9526-4ec4-962f-a3754b1cc291 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:41.645108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eb3e6-fec4-48e2-9da2-51230018aa1a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:41.677320 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36681558-e044-4e4d-832e-f8f2519218ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:41.678154 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36681558-e044-4e4d-832e-f8f2519218ec None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.678446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36681558-e044-4e4d-832e-f8f2519218ec None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.678727 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36681558-e044-4e4d-832e-f8f2519218ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.680008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36681558-e044-4e4d-832e-f8f2519218ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:41.681467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36681558-e044-4e4d-832e-f8f2519218ec None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:41.683812 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 19/42] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:41.684555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36681558-e044-4e4d-832e-f8f2519218ec None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:41.688572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79b9ce-9526-4ec4-962f-a3754b1cc291 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:41.722049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cfe81-876e-41d3-8b38-eeef4aab25aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:41.722848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cfe81-876e-41d3-8b38-eeef4aab25aa None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.723130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cfe81-876e-41d3-8b38-eeef4aab25aa None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.723403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cfe81-876e-41d3-8b38-eeef4aab25aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.724834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cfe81-876e-41d3-8b38-eeef4aab25aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:41.726324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cfe81-876e-41d3-8b38-eeef4aab25aa None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:41.727932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 24/43] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:41.732699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cfe81-876e-41d3-8b38-eeef4aab25aa None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:41.781690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36681558-e044-4e4d-832e-f8f2519218ec None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:41.814831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407339f6-423c-47d0-b6eb-54b781d255ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:41.820384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407339f6-423c-47d0-b6eb-54b781d255ab None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.820384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407339f6-423c-47d0-b6eb-54b781d255ab None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.820384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407339f6-423c-47d0-b6eb-54b781d255ab None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.820384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407339f6-423c-47d0-b6eb-54b781d255ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:41.820384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407339f6-423c-47d0-b6eb-54b781d255ab None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:41.826950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cfe81-876e-41d3-8b38-eeef4aab25aa None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:41.861538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439daa05-b60c-4238-8a3d-470e822e2ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:41.862241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439daa05-b60c-4238-8a3d-470e822e2ef2 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:41.862528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439daa05-b60c-4238-8a3d-470e822e2ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:41.862805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439daa05-b60c-4238-8a3d-470e822e2ef2 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:41.863515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439daa05-b60c-4238-8a3d-470e822e2ef2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:41.864960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439daa05-b60c-4238-8a3d-470e822e2ef2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:41.960337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 25/44] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:34:41 2022] POST /identity/v3/projects => generated 312 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:34:41.961130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439daa05-b60c-4238-8a3d-470e822e2ef2 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:42.001335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 20/45] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Feb 28 21:34:41 2022] POST /identity/v3/roles => generated 223 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:34:42.075187 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439daa05-b60c-4238-8a3d-470e822e2ef2 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:42.114120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f54d92-6a6f-4123-affd-185017d9f45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:42.115034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f54d92-6a6f-4123-affd-185017d9f45a None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:42.115318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f54d92-6a6f-4123-affd-185017d9f45a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:42.115600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f54d92-6a6f-4123-affd-185017d9f45a None admin] PATH_INFO: `/v3/domains/default/users/3a718f2072b24450a97264ccf1958236/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:42.118079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f54d92-6a6f-4123-affd-185017d9f45a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3a718f2072b24450a97264ccf1958236, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:42.119577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f54d92-6a6f-4123-affd-185017d9f45a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:42.201900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 26/46] 10.222.0.26 () {58 vars in 1361 bytes} [Mon Feb 28 21:34:41 2022] PUT /identity/v3/domains/default/users/3a718f2072b24450a97264ccf1958236/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:34:44.283755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5f66-0688-44ba-843d-404147a2f01a None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:44.284242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5f66-0688-44ba-843d-404147a2f01a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:44.284242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5f66-0688-44ba-843d-404147a2f01a None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:44.286050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 21/47] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:44.291313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ea6ac-5635-402f-8e46-a2796e645526 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:44.291737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ea6ac-5635-402f-8e46-a2796e645526 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:44.291871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ea6ac-5635-402f-8e46-a2796e645526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:44.309671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-453ea6ac-5635-402f-8e46-a2796e645526 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:44.310863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-453ea6ac-5635-402f-8e46-a2796e645526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:44.373945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 27/48] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:44.397050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5f66-0688-44ba-843d-404147a2f01a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:44.469662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339e57d-e257-48db-9987-1174cc014bf9 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:44.469947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339e57d-e257-48db-9987-1174cc014bf9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:44.470317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339e57d-e257-48db-9987-1174cc014bf9 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:44.472075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 28/49] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:34:44.476958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b680-1333-4b22-bbb2-4e7eff888b23 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:44.477243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b680-1333-4b22-bbb2-4e7eff888b23 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:44.477513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b680-1333-4b22-bbb2-4e7eff888b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:44.494322 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2441b680-1333-4b22-bbb2-4e7eff888b23 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:44.495571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2441b680-1333-4b22-bbb2-4e7eff888b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:44.495747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5f66-0688-44ba-843d-404147a2f01a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:44.527592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb7aa-394b-42c9-85a9-d2e6c041d49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:44.528388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb7aa-394b-42c9-85a9-d2e6c041d49a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:44.528666 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb7aa-394b-42c9-85a9-d2e6c041d49a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:44.528938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcb7aa-394b-42c9-85a9-d2e6c041d49a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:44.530154 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcb7aa-394b-42c9-85a9-d2e6c041d49a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:44.531602 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcb7aa-394b-42c9-85a9-d2e6c041d49a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:44.533196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 22/50] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:34:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:44.538666 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb7aa-394b-42c9-85a9-d2e6c041d49a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:44.559778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 29/51] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:34:44.582262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b680-1333-4b22-bbb2-4e7eff888b23 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:44.631930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcb7aa-394b-42c9-85a9-d2e6c041d49a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:44.663140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d190-f45c-4083-ab21-c9466a175525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:44.663791 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d190-f45c-4083-ab21-c9466a175525 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:44.664070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d190-f45c-4083-ab21-c9466a175525 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:44.664339 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1d190-f45c-4083-ab21-c9466a175525 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:44.665039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1d190-f45c-4083-ab21-c9466a175525 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:44.666514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1d190-f45c-4083-ab21-c9466a175525 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:44.680626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b680-1333-4b22-bbb2-4e7eff888b23 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:44.712523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bf914-b3bc-47ec-be0e-f7671152261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:44.713310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bf914-b3bc-47ec-be0e-f7671152261c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:44.713589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bf914-b3bc-47ec-be0e-f7671152261c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:44.713859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bf914-b3bc-47ec-be0e-f7671152261c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:44.725108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bf914-b3bc-47ec-be0e-f7671152261c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:44.732689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-1a5bf914-b3bc-47ec-be0e-f7671152261c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:34:44.733875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 30/52] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:34:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:34:44.739776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bf914-b3bc-47ec-be0e-f7671152261c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:44.757188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 23/53] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Feb 28 21:34:44 2022] POST /identity/v3/projects => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:34:44.847586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bf914-b3bc-47ec-be0e-f7671152261c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:44.883342 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd08bd-5eb7-4ec6-b570-72d5130c9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:44.884041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd08bd-5eb7-4ec6-b570-72d5130c9f17 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:44.884329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd08bd-5eb7-4ec6-b570-72d5130c9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:44.884609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd08bd-5eb7-4ec6-b570-72d5130c9f17 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:44.885378 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd08bd-5eb7-4ec6-b570-72d5130c9f17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:44.885688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd08bd-5eb7-4ec6-b570-72d5130c9f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:44.888643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd08bd-5eb7-4ec6-b570-72d5130c9f17 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:44.907579 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 31/54] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:44.908963 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d190-f45c-4083-ab21-c9466a175525 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:45.006423 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1d190-f45c-4083-ab21-c9466a175525 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:45.039818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdabf9-a178-49f5-98ec-632533b9654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:45.040683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdabf9-a178-49f5-98ec-632533b9654a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:45.040960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdabf9-a178-49f5-98ec-632533b9654a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:45.041228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdabf9-a178-49f5-98ec-632533b9654a None admin] PATH_INFO: `/v3/users/3a718f2072b24450a97264ccf1958236` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:45.042595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdabf9-a178-49f5-98ec-632533b9654a None admin] RBAC: Authorizing `identity:get_user(user_id=3a718f2072b24450a97264ccf1958236)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:45.044025 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdabf9-a178-49f5-98ec-632533b9654a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:45.045627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 24/55] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:44 2022] GET /identity/v3/users/3a718f2072b24450a97264ccf1958236 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:45.050959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd08bd-5eb7-4ec6-b570-72d5130c9f17 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:45.150675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd08bd-5eb7-4ec6-b570-72d5130c9f17 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:45.186401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ddb81-9769-40cd-8035-75fd35c5339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:45.187193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ddb81-9769-40cd-8035-75fd35c5339d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:45.187475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ddb81-9769-40cd-8035-75fd35c5339d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:45.187748 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ddb81-9769-40cd-8035-75fd35c5339d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:45.188912 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ddb81-9769-40cd-8035-75fd35c5339d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:45.190376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ddb81-9769-40cd-8035-75fd35c5339d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:45.192001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 32/56] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:34:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:45.197586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdabf9-a178-49f5-98ec-632533b9654a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:45.296834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdabf9-a178-49f5-98ec-632533b9654a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:45.329747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c1087-9050-436f-ad54-6533ee552516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:45.330446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c1087-9050-436f-ad54-6533ee552516 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:45.330729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c1087-9050-436f-ad54-6533ee552516 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:45.331010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c1087-9050-436f-ad54-6533ee552516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:45.331908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c1087-9050-436f-ad54-6533ee552516 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.domain.id=default, user.id=3a718f2072b24450a97264ccf1958236) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:45.332221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c1087-9050-436f-ad54-6533ee552516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:45.333647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c1087-9050-436f-ad54-6533ee552516 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:45.339387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 25/57] 10.222.0.26 () {56 vars in 1322 bytes} [Mon Feb 28 21:34:45 2022] GET /identity/v3/role_assignments?user.id=3a718f2072b24450a97264ccf1958236&scope.domain.id=default&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:47.072687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58bd3-c04d-4447-a5d8-33de6ec6eb55 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:47.073752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58bd3-c04d-4447-a5d8-33de6ec6eb55 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:47.073752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58bd3-c04d-4447-a5d8-33de6ec6eb55 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:47.075574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 33/58] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:47.080832 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9255f-4103-4c49-a4bc-b8c13519061e None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:47.081264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9255f-4103-4c49-a4bc-b8c13519061e None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:47.081390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9255f-4103-4c49-a4bc-b8c13519061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:47.098812 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8ac9255f-4103-4c49-a4bc-b8c13519061e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:47.100308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8ac9255f-4103-4c49-a4bc-b8c13519061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:47.163505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 26/59] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:47.187610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae58bd3-c04d-4447-a5d8-33de6ec6eb55 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:47.282592 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae58bd3-c04d-4447-a5d8-33de6ec6eb55 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:47.314465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136adbe-d462-4dff-adaa-abf5279750bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:47.315241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136adbe-d462-4dff-adaa-abf5279750bd None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:47.315526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136adbe-d462-4dff-adaa-abf5279750bd None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:47.315804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136adbe-d462-4dff-adaa-abf5279750bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:47.316980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136adbe-d462-4dff-adaa-abf5279750bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:47.318434 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136adbe-d462-4dff-adaa-abf5279750bd None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:47.320009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 34/60] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:34:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:47.325835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9255f-4103-4c49-a4bc-b8c13519061e None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:47.419234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9255f-4103-4c49-a4bc-b8c13519061e None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:47.451047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cc00a-fe47-4f6d-b6f7-e1c5a9a422e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:47.451703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cc00a-fe47-4f6d-b6f7-e1c5a9a422e2 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:47.451988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cc00a-fe47-4f6d-b6f7-e1c5a9a422e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:47.452266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cc00a-fe47-4f6d-b6f7-e1c5a9a422e2 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:47.452966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cc00a-fe47-4f6d-b6f7-e1c5a9a422e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:47.454428 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cc00a-fe47-4f6d-b6f7-e1c5a9a422e2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:47.578060 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 27/61] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:34:47 2022] POST /identity/v3/users => generated 275 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:34:51.008088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874be4c-b38f-4055-b3d7-65958ffda911 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.008968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874be4c-b38f-4055-b3d7-65958ffda911 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.009448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874be4c-b38f-4055-b3d7-65958ffda911 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.012758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 35/62] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:51.018613 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448824db-1fc0-4553-8f4d-b7e81163a58d None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.019078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448824db-1fc0-4553-8f4d-b7e81163a58d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.019187 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448824db-1fc0-4553-8f4d-b7e81163a58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.043007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-448824db-1fc0-4553-8f4d-b7e81163a58d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:51.044204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-448824db-1fc0-4553-8f4d-b7e81163a58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:51.124463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 28/63] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:51.165426 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874be4c-b38f-4055-b3d7-65958ffda911 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:51.173457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506498-8d4b-429b-abe5-a6d362a185b9 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.173956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506498-8d4b-429b-abe5-a6d362a185b9 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.174411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506498-8d4b-429b-abe5-a6d362a185b9 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.176602 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 29/64] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:51.183088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62440c-5972-4500-9700-6a47e408625a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.183560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62440c-5972-4500-9700-6a47e408625a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.183988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62440c-5972-4500-9700-6a47e408625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.200966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1a62440c-5972-4500-9700-6a47e408625a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:51.202444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1a62440c-5972-4500-9700-6a47e408625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:51.301636 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 30/65] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:34:51.325215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62440c-5972-4500-9700-6a47e408625a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:51.349278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874be4c-b38f-4055-b3d7-65958ffda911 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:51.394109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa463e5-6363-4c4a-adee-6769c1fdf859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:51.395590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa463e5-6363-4c4a-adee-6769c1fdf859 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.396294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa463e5-6363-4c4a-adee-6769c1fdf859 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.396722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa463e5-6363-4c4a-adee-6769c1fdf859 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.412325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa463e5-6363-4c4a-adee-6769c1fdf859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:51.422975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-cfa463e5-6363-4c4a-adee-6769c1fdf859 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:34:51.424871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 36/66] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:34:51.426563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40abe-2790-4ea7-bcf9-2e0785024bbb None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.427585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40abe-2790-4ea7-bcf9-2e0785024bbb None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.428041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40abe-2790-4ea7-bcf9-2e0785024bbb None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.431508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 37/67] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:51.433212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40abe-2790-4ea7-bcf9-2e0785024bbb None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:51.444655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62440c-5972-4500-9700-6a47e408625a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:51.480440 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d08f5b-275c-4ff4-a1f2-b69186f83809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:51.481252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d08f5b-275c-4ff4-a1f2-b69186f83809 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.481536 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d08f5b-275c-4ff4-a1f2-b69186f83809 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.481822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d08f5b-275c-4ff4-a1f2-b69186f83809 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.492287 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d08f5b-275c-4ff4-a1f2-b69186f83809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:51.500018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-c2d08f5b-275c-4ff4-a1f2-b69186f83809 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:34:51.501421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 31/68] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:34:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:34:51.507585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a01b82-0938-4046-92a4-cdcb2ceb8c96 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.508045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a01b82-0938-4046-92a4-cdcb2ceb8c96 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.508486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a01b82-0938-4046-92a4-cdcb2ceb8c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.526234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f5a01b82-0938-4046-92a4-cdcb2ceb8c96 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:51.527569 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f5a01b82-0938-4046-92a4-cdcb2ceb8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:51.538532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40abe-2790-4ea7-bcf9-2e0785024bbb None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:51.571732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68b1c6-4ee6-4e6f-b6a7-7b55b7cf52c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:51.572398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68b1c6-4ee6-4e6f-b6a7-7b55b7cf52c4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.572681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68b1c6-4ee6-4e6f-b6a7-7b55b7cf52c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.573476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68b1c6-4ee6-4e6f-b6a7-7b55b7cf52c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.574266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68b1c6-4ee6-4e6f-b6a7-7b55b7cf52c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:51.574569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68b1c6-4ee6-4e6f-b6a7-7b55b7cf52c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:51.575943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68b1c6-4ee6-4e6f-b6a7-7b55b7cf52c4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:51.585630 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 38/69] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:34:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:51.586720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68b1c6-4ee6-4e6f-b6a7-7b55b7cf52c4 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:51.594903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 32/70] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:51.596457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2cb3-cc21-483a-b060-9959d25f2072 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.596926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2cb3-cc21-483a-b060-9959d25f2072 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.597359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2cb3-cc21-483a-b060-9959d25f2072 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.599233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 33/71] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:51.600075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c2cb3-cc21-483a-b060-9959d25f2072 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:51.693207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68b1c6-4ee6-4e6f-b6a7-7b55b7cf52c4 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:51.705698 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c2cb3-cc21-483a-b060-9959d25f2072 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:51.725555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293921e0-0b7d-4900-8119-20239699495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:51.726269 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293921e0-0b7d-4900-8119-20239699495c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.726554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293921e0-0b7d-4900-8119-20239699495c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.726923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293921e0-0b7d-4900-8119-20239699495c None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.727676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293921e0-0b7d-4900-8119-20239699495c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:51.727986 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293921e0-0b7d-4900-8119-20239699495c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:51.730090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293921e0-0b7d-4900-8119-20239699495c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:51.737914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 39/72] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:51.739352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d2257-d781-4012-9c6b-edae22fde8fe None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.739640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d2257-d781-4012-9c6b-edae22fde8fe None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.739916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d2257-d781-4012-9c6b-edae22fde8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.743929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f8744-6653-47f3-a6ab-794c39a3d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:51.745577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f8744-6653-47f3-a6ab-794c39a3d051 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.746577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f8744-6653-47f3-a6ab-794c39a3d051 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.747006 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f8744-6653-47f3-a6ab-794c39a3d051 None admin] PATH_INFO: `/v3/users/da54df780f9b46fe86e8cbde5bc268ac` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.757495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-fc4d2257-d781-4012-9c6b-edae22fde8fe None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:51.758713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fc4d2257-d781-4012-9c6b-edae22fde8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:51.761661 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f8744-6653-47f3-a6ab-794c39a3d051 None admin] RBAC: Authorizing `identity:get_user(user_id=da54df780f9b46fe86e8cbde5bc268ac)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:51.763557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f8744-6653-47f3-a6ab-794c39a3d051 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:51.765404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 34/73] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:51 2022] GET /identity/v3/users/da54df780f9b46fe86e8cbde5bc268ac => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:51.766323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f8744-6653-47f3-a6ab-794c39a3d051 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:51.827427 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 40/74] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:51.830891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d2257-d781-4012-9c6b-edae22fde8fe None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:51.864430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f8744-6653-47f3-a6ab-794c39a3d051 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:51.897570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492bdab-b43b-402f-a175-801151805f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:51.898412 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492bdab-b43b-402f-a175-801151805f32 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.898701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492bdab-b43b-402f-a175-801151805f32 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.898982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492bdab-b43b-402f-a175-801151805f32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.909365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492bdab-b43b-402f-a175-801151805f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:51.916711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-b492bdab-b43b-402f-a175-801151805f32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:34:51.918460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 35/75] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:34:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:34:51.919749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a7aa-facd-4f3d-8233-18c9eb1417c4 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.920041 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a7aa-facd-4f3d-8233-18c9eb1417c4 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.920320 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a7aa-facd-4f3d-8233-18c9eb1417c4 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.922163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 36/76] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:51.923986 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80a7aa-facd-4f3d-8233-18c9eb1417c4 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:51.925524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d2257-d781-4012-9c6b-edae22fde8fe None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:51.957720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b26896-4c6e-49c5-8d47-6ebc239b8e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:51.958531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26896-4c6e-49c5-8d47-6ebc239b8e53 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:51.958814 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26896-4c6e-49c5-8d47-6ebc239b8e53 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:51.959085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26896-4c6e-49c5-8d47-6ebc239b8e53 None admin] PATH_INFO: `/v3/users/3a718f2072b24450a97264ccf1958236` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:51.960261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b26896-4c6e-49c5-8d47-6ebc239b8e53 None admin] RBAC: Authorizing `identity:get_user(user_id=3a718f2072b24450a97264ccf1958236)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:51.961693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b26896-4c6e-49c5-8d47-6ebc239b8e53 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:51.963514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 41/77] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:51 2022] GET /identity/v3/users/3a718f2072b24450a97264ccf1958236 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:51.964711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b26896-4c6e-49c5-8d47-6ebc239b8e53 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.019860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80a7aa-facd-4f3d-8233-18c9eb1417c4 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.051383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f61aa9-cc27-465b-8d6c-a4d1cf4e6031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.052030 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f61aa9-cc27-465b-8d6c-a4d1cf4e6031 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.052315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f61aa9-cc27-465b-8d6c-a4d1cf4e6031 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.052594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f61aa9-cc27-465b-8d6c-a4d1cf4e6031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.057188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b26896-4c6e-49c5-8d47-6ebc239b8e53 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.090594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2f31-47b5-4ddb-af08-9e01fde5904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.091381 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2f31-47b5-4ddb-af08-9e01fde5904c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.091665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2f31-47b5-4ddb-af08-9e01fde5904c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.091945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2f31-47b5-4ddb-af08-9e01fde5904c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.101713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc2f31-47b5-4ddb-af08-9e01fde5904c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:52.109358 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-4fcc2f31-47b5-4ddb-af08-9e01fde5904c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:34:52.110565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 42/78] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:34:52.111333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2f31-47b5-4ddb-af08-9e01fde5904c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.117732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f61aa9-cc27-465b-8d6c-a4d1cf4e6031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:52.119299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f61aa9-cc27-465b-8d6c-a4d1cf4e6031 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:52.212562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 37/79] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:34:52.215755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60535-a57c-45dd-9dd6-4863a019aade None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.215755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60535-a57c-45dd-9dd6-4863a019aade None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.215755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60535-a57c-45dd-9dd6-4863a019aade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.219294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2f31-47b5-4ddb-af08-9e01fde5904c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.232387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-3aa60535-a57c-45dd-9dd6-4863a019aade None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:52.233592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3aa60535-a57c-45dd-9dd6-4863a019aade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:52.251442 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853d90b-2125-467d-b53e-3e57b4c45b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.252108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853d90b-2125-467d-b53e-3e57b4c45b8f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.252395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853d90b-2125-467d-b53e-3e57b4c45b8f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.252677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853d90b-2125-467d-b53e-3e57b4c45b8f None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.253417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853d90b-2125-467d-b53e-3e57b4c45b8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:52.253724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853d90b-2125-467d-b53e-3e57b4c45b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:52.255140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853d90b-2125-467d-b53e-3e57b4c45b8f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:52.263503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 43/80] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:34:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:52.264364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853d90b-2125-467d-b53e-3e57b4c45b8f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.300618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 38/81] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:52.301639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60535-a57c-45dd-9dd6-4863a019aade None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.362512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853d90b-2125-467d-b53e-3e57b4c45b8f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.394191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60535-a57c-45dd-9dd6-4863a019aade None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.394378 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cf44b-aace-4ce1-83fc-c9a94cd9ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.395028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cf44b-aace-4ce1-83fc-c9a94cd9ba2d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.395311 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cf44b-aace-4ce1-83fc-c9a94cd9ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.395583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cf44b-aace-4ce1-83fc-c9a94cd9ba2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.425718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63169dd-f525-47b1-bf66-b1b3e1e5a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.426406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63169dd-f525-47b1-bf66-b1b3e1e5a07d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.426683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63169dd-f525-47b1-bf66-b1b3e1e5a07d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.426954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63169dd-f525-47b1-bf66-b1b3e1e5a07d None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.427690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63169dd-f525-47b1-bf66-b1b3e1e5a07d None admin] RBAC: Adding query filter params (name=member) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:52.427991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63169dd-f525-47b1-bf66-b1b3e1e5a07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:52.429358 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63169dd-f525-47b1-bf66-b1b3e1e5a07d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:52.437227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 39/82] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:34:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:52.438091 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63169dd-f525-47b1-bf66-b1b3e1e5a07d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.460225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cf44b-aace-4ce1-83fc-c9a94cd9ba2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:52.461691 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cf44b-aace-4ce1-83fc-c9a94cd9ba2d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:52.530469 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63169dd-f525-47b1-bf66-b1b3e1e5a07d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.553805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 44/83] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:34:52.554661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cf44b-aace-4ce1-83fc-c9a94cd9ba2d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.564411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f23399-4b44-4a81-89f3-002d3849176c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.565274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f23399-4b44-4a81-89f3-002d3849176c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.565556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f23399-4b44-4a81-89f3-002d3849176c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.565831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f23399-4b44-4a81-89f3-002d3849176c None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.567064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f23399-4b44-4a81-89f3-002d3849176c None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:52.568531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f23399-4b44-4a81-89f3-002d3849176c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:52.570254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 40/84] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:34:52 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:52.571008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f23399-4b44-4a81-89f3-002d3849176c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.647581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cf44b-aace-4ce1-83fc-c9a94cd9ba2d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.666055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f23399-4b44-4a81-89f3-002d3849176c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.679756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf324a7-8107-4bf8-8c3f-ea5cfda47be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.680622 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf324a7-8107-4bf8-8c3f-ea5cfda47be4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.680906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf324a7-8107-4bf8-8c3f-ea5cfda47be4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.681183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf324a7-8107-4bf8-8c3f-ea5cfda47be4 None admin] PATH_INFO: `/v3/users/da54df780f9b46fe86e8cbde5bc268ac` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.682496 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf324a7-8107-4bf8-8c3f-ea5cfda47be4 None admin] RBAC: Authorizing `identity:get_user(user_id=da54df780f9b46fe86e8cbde5bc268ac)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:52.683944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf324a7-8107-4bf8-8c3f-ea5cfda47be4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:52.685559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 45/85] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:52 2022] GET /identity/v3/users/da54df780f9b46fe86e8cbde5bc268ac => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:52.686344 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf324a7-8107-4bf8-8c3f-ea5cfda47be4 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.698424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29da9b-0cd0-4d3e-b98a-bd45b6717f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.699218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29da9b-0cd0-4d3e-b98a-bd45b6717f64 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.699504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29da9b-0cd0-4d3e-b98a-bd45b6717f64 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.699781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29da9b-0cd0-4d3e-b98a-bd45b6717f64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.700950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29da9b-0cd0-4d3e-b98a-bd45b6717f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:52.702430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29da9b-0cd0-4d3e-b98a-bd45b6717f64 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:52.704049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 41/86] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:34:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:52.704805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29da9b-0cd0-4d3e-b98a-bd45b6717f64 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.782427 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf324a7-8107-4bf8-8c3f-ea5cfda47be4 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.799527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29da9b-0cd0-4d3e-b98a-bd45b6717f64 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.813572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59894509-bf50-4610-b91d-d46787ed953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.814456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59894509-bf50-4610-b91d-d46787ed953e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.814745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59894509-bf50-4610-b91d-d46787ed953e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.815011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59894509-bf50-4610-b91d-d46787ed953e None admin] PATH_INFO: `/v3/users/da54df780f9b46fe86e8cbde5bc268ac` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.816216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59894509-bf50-4610-b91d-d46787ed953e None admin] RBAC: Authorizing `identity:get_user(user_id=da54df780f9b46fe86e8cbde5bc268ac)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:52.817656 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59894509-bf50-4610-b91d-d46787ed953e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:52.819303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 46/87] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:52 2022] GET /identity/v3/users/da54df780f9b46fe86e8cbde5bc268ac => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:52.820063 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59894509-bf50-4610-b91d-d46787ed953e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.832744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bee84-d7a3-4d6f-9f4b-259a39b0a216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.833609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bee84-d7a3-4d6f-9f4b-259a39b0a216 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.833896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bee84-d7a3-4d6f-9f4b-259a39b0a216 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.834204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bee84-d7a3-4d6f-9f4b-259a39b0a216 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.835389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bee84-d7a3-4d6f-9f4b-259a39b0a216 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:52.836836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bee84-d7a3-4d6f-9f4b-259a39b0a216 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:52.838712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 42/88] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:34:52 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:52.839326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bee84-d7a3-4d6f-9f4b-259a39b0a216 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.917329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59894509-bf50-4610-b91d-d46787ed953e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.933764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bee84-d7a3-4d6f-9f4b-259a39b0a216 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:52.949927 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20cdde-1852-4a72-8f95-5c5fb0a6f8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.952515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20cdde-1852-4a72-8f95-5c5fb0a6f8fc None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.952797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20cdde-1852-4a72-8f95-5c5fb0a6f8fc None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.953069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20cdde-1852-4a72-8f95-5c5fb0a6f8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:52.953887 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20cdde-1852-4a72-8f95-5c5fb0a6f8fc None admin] RBAC: Adding query filter params (role.id=b15932e4d63b437eb478fd41d0ae6ec6, scope.project.id=7b3f655528294e62a0a33ce69e504013, user.id=da54df780f9b46fe86e8cbde5bc268ac) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:52.954222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20cdde-1852-4a72-8f95-5c5fb0a6f8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:52.955646 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20cdde-1852-4a72-8f95-5c5fb0a6f8fc None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:52.963301 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 47/89] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:34:52 2022] GET /identity/v3/role_assignments?user.id=da54df780f9b46fe86e8cbde5bc268ac&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:52.963840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20cdde-1852-4a72-8f95-5c5fb0a6f8fc None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:52.966065 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758b85-2b34-4eb5-ac77-a02728c48cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:52.966744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758b85-2b34-4eb5-ac77-a02728c48cc4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:52.967015 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758b85-2b34-4eb5-ac77-a02728c48cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:52.967293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758b85-2b34-4eb5-ac77-a02728c48cc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:53.040653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce758b85-2b34-4eb5-ac77-a02728c48cc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:53.043269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce758b85-2b34-4eb5-ac77-a02728c48cc4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:53.070366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20cdde-1852-4a72-8f95-5c5fb0a6f8fc None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:53.106549 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630a99-6b39-40e6-844d-b963bf253ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:53.107242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630a99-6b39-40e6-844d-b963bf253ddd None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:53.107529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630a99-6b39-40e6-844d-b963bf253ddd None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:53.107807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2630a99-6b39-40e6-844d-b963bf253ddd None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:53.108537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2630a99-6b39-40e6-844d-b963bf253ddd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:53.110094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2630a99-6b39-40e6-844d-b963bf253ddd None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:53.149354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 43/90] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:34:53.150562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758b85-2b34-4eb5-ac77-a02728c48cc4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:53.195576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 48/91] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:34:52 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:34:53.196683 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630a99-6b39-40e6-844d-b963bf253ddd None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:53.257857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758b85-2b34-4eb5-ac77-a02728c48cc4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:53.295995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f9f41-d8ca-4c51-88e6-61f53e388ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:53.296979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9f41-d8ca-4c51-88e6-61f53e388ebf None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:53.297452 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9f41-d8ca-4c51-88e6-61f53e388ebf None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:53.297905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9f41-d8ca-4c51-88e6-61f53e388ebf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:53.314409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2630a99-6b39-40e6-844d-b963bf253ddd None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:53.351365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09c3a6-eb23-4f2d-9929-b822a8c83b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:53.352297 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09c3a6-eb23-4f2d-9929-b822a8c83b03 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:53.352404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09c3a6-eb23-4f2d-9929-b822a8c83b03 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:53.352648 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09c3a6-eb23-4f2d-9929-b822a8c83b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:53.353509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09c3a6-eb23-4f2d-9929-b822a8c83b03 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=7b3f655528294e62a0a33ce69e504013, user.id=3a718f2072b24450a97264ccf1958236) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:53.353823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09c3a6-eb23-4f2d-9929-b822a8c83b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:53.355991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09c3a6-eb23-4f2d-9929-b822a8c83b03 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:53.362197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 49/92] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:34:53 2022] GET /identity/v3/role_assignments?user.id=3a718f2072b24450a97264ccf1958236&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:53.363141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09c3a6-eb23-4f2d-9929-b822a8c83b03 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:53.374827 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f9f41-d8ca-4c51-88e6-61f53e388ebf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:53.376755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f9f41-d8ca-4c51-88e6-61f53e388ebf None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:53.476333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09c3a6-eb23-4f2d-9929-b822a8c83b03 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:53.489090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 44/93] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:34:53.494325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f9f41-d8ca-4c51-88e6-61f53e388ebf None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:53.518328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de3185-a766-4fff-8967-0f86009f938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:53.518977 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de3185-a766-4fff-8967-0f86009f938d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:53.519263 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de3185-a766-4fff-8967-0f86009f938d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:53.519542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de3185-a766-4fff-8967-0f86009f938d None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:53.520886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de3185-a766-4fff-8967-0f86009f938d None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:53.522931 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de3185-a766-4fff-8967-0f86009f938d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:53.524665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 50/94] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:34:53 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:53.532400 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de3185-a766-4fff-8967-0f86009f938d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:53.606974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f9f41-d8ca-4c51-88e6-61f53e388ebf None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:53.641788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de3185-a766-4fff-8967-0f86009f938d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:53.643914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc6d2a-0acb-4505-8d27-3ebacf1e78a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:53.644796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc6d2a-0acb-4505-8d27-3ebacf1e78a9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:53.645082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc6d2a-0acb-4505-8d27-3ebacf1e78a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:53.645359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc6d2a-0acb-4505-8d27-3ebacf1e78a9 None admin] PATH_INFO: `/v3/projects/05e3ffaf21b14ae8810a7f8127490ed8` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:53.646603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc6d2a-0acb-4505-8d27-3ebacf1e78a9 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3ffaf21b14ae8810a7f8127490ed8)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:53.648066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc6d2a-0acb-4505-8d27-3ebacf1e78a9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:53.649777 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 45/95] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:34:53 2022] GET /identity/v3/projects/05e3ffaf21b14ae8810a7f8127490ed8 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:53.656358 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc6d2a-0acb-4505-8d27-3ebacf1e78a9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:53.687476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fc54a-1fa3-4f04-a40c-0304befccc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:53.688510 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fc54a-1fa3-4f04-a40c-0304befccc6b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:53.689014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fc54a-1fa3-4f04-a40c-0304befccc6b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:53.689627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fc54a-1fa3-4f04-a40c-0304befccc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:53.691345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fc54a-1fa3-4f04-a40c-0304befccc6b None admin] RBAC: Adding query filter params (role.id=e83d49af62db4f4aa2dcadb10a82bfdc, scope.project.id=7b3f655528294e62a0a33ce69e504013, user.id=da54df780f9b46fe86e8cbde5bc268ac) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:53.691846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fc54a-1fa3-4f04-a40c-0304befccc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:53.693746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fc54a-1fa3-4f04-a40c-0304befccc6b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:53.704352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 51/96] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:34:53 2022] GET /identity/v3/role_assignments?user.id=da54df780f9b46fe86e8cbde5bc268ac&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=e83d49af62db4f4aa2dcadb10a82bfdc => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:53.770127 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc6d2a-0acb-4505-8d27-3ebacf1e78a9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:53.809047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfda8a-de05-40f6-9119-e222dd198e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:53.809724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfda8a-de05-40f6-9119-e222dd198e71 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:53.810031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfda8a-de05-40f6-9119-e222dd198e71 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:53.810318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfda8a-de05-40f6-9119-e222dd198e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:53.811166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfda8a-de05-40f6-9119-e222dd198e71 None admin] RBAC: Adding query filter params (role.id=b15932e4d63b437eb478fd41d0ae6ec6, scope.project.id=05e3ffaf21b14ae8810a7f8127490ed8, user.id=da54df780f9b46fe86e8cbde5bc268ac) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:53.811481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfda8a-de05-40f6-9119-e222dd198e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:53.813066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfda8a-de05-40f6-9119-e222dd198e71 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:53.819630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 46/97] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:34:53 2022] GET /identity/v3/role_assignments?user.id=da54df780f9b46fe86e8cbde5bc268ac&scope.project.id=05e3ffaf21b14ae8810a7f8127490ed8&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:55.789438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e96dbb-3ff2-4552-ac9d-d6623c0c0287 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:55.789943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e96dbb-3ff2-4552-ac9d-d6623c0c0287 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:55.790047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e96dbb-3ff2-4552-ac9d-d6623c0c0287 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:55.792583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 52/98] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:55.798023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276f1c6-d301-466c-bca9-47b266a392ea None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:55.798435 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276f1c6-d301-466c-bca9-47b266a392ea None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:55.798602 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276f1c6-d301-466c-bca9-47b266a392ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:55.822018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-b276f1c6-d301-466c-bca9-47b266a392ea None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:55.823279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b276f1c6-d301-466c-bca9-47b266a392ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:55.920455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 47/99] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:55.959460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e96dbb-3ff2-4552-ac9d-d6623c0c0287 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:56.079660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e96dbb-3ff2-4552-ac9d-d6623c0c0287 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:56.117404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd924a-20d9-4161-9223-2aec2308baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:56.118248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd924a-20d9-4161-9223-2aec2308baad None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:56.118531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd924a-20d9-4161-9223-2aec2308baad None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:56.118802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd924a-20d9-4161-9223-2aec2308baad None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:56.129888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd924a-20d9-4161-9223-2aec2308baad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:56.141526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-8bbd924a-20d9-4161-9223-2aec2308baad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:34:56.142842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 53/100] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:34:56.148741 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276f1c6-d301-466c-bca9-47b266a392ea None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:56.291205 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276f1c6-d301-466c-bca9-47b266a392ea None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:56.326625 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2c8cc-a173-4c80-b406-de55947eb706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:56.327305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2c8cc-a173-4c80-b406-de55947eb706 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:56.327590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2c8cc-a173-4c80-b406-de55947eb706 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:56.327870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2c8cc-a173-4c80-b406-de55947eb706 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:56.328621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2c8cc-a173-4c80-b406-de55947eb706 None admin] RBAC: Adding query filter params (name=member) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:56.328932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2c8cc-a173-4c80-b406-de55947eb706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:56.330460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2c8cc-a173-4c80-b406-de55947eb706 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:56.339209 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 48/101] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:34:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:56.345618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd924a-20d9-4161-9223-2aec2308baad None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:56.480181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd924a-20d9-4161-9223-2aec2308baad None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:56.517461 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a164f-9565-4f1d-bb01-586ebf7fc2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:56.518376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a164f-9565-4f1d-bb01-586ebf7fc2a2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:56.518661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a164f-9565-4f1d-bb01-586ebf7fc2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:56.518942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a164f-9565-4f1d-bb01-586ebf7fc2a2 None admin] PATH_INFO: `/v3/users/da54df780f9b46fe86e8cbde5bc268ac` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:56.520167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a164f-9565-4f1d-bb01-586ebf7fc2a2 None admin] RBAC: Authorizing `identity:get_user(user_id=da54df780f9b46fe86e8cbde5bc268ac)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:56.521616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a164f-9565-4f1d-bb01-586ebf7fc2a2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:56.523437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 54/102] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:56 2022] GET /identity/v3/users/da54df780f9b46fe86e8cbde5bc268ac => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:56.529603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2c8cc-a173-4c80-b406-de55947eb706 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:56.647854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93b36c-9439-4dbe-88b8-a6c18febb767 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:56.648138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93b36c-9439-4dbe-88b8-a6c18febb767 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:56.648326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93b36c-9439-4dbe-88b8-a6c18febb767 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:56.650383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 55/103] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:56.655927 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c660-8e95-4adc-9cea-53931a5d6ef9 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:56.656212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c660-8e95-4adc-9cea-53931a5d6ef9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:56.656493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c660-8e95-4adc-9cea-53931a5d6ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:56.681359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2c8cc-a173-4c80-b406-de55947eb706 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:56.689508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-7b15c660-8e95-4adc-9cea-53931a5d6ef9 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:56.702933 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7b15c660-8e95-4adc-9cea-53931a5d6ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:56.728859 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f5fb8-40d3-4d5e-82a7-3e0dd58d21c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:56.730531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f5fb8-40d3-4d5e-82a7-3e0dd58d21c0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:56.730819 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f5fb8-40d3-4d5e-82a7-3e0dd58d21c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:56.731100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f5fb8-40d3-4d5e-82a7-3e0dd58d21c0 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:56.732961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f5fb8-40d3-4d5e-82a7-3e0dd58d21c0 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:56.734670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f5fb8-40d3-4d5e-82a7-3e0dd58d21c0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:56.737381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 49/104] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:34:56 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:56.743539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f5fb8-40d3-4d5e-82a7-3e0dd58d21c0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:56.829461 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 56/105] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:34:56.830870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233030-1769-4690-b881-7086df9e141e None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:56.831158 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233030-1769-4690-b881-7086df9e141e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:56.831446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64233030-1769-4690-b881-7086df9e141e None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:56.833138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 57/106] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:56.840324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e2fef-e4b6-4f43-9a06-5d0c0884db92 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:56.840612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e2fef-e4b6-4f43-9a06-5d0c0884db92 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:56.840889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e2fef-e4b6-4f43-9a06-5d0c0884db92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:56.869272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b85e2fef-e4b6-4f43-9a06-5d0c0884db92 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:56.870924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b85e2fef-e4b6-4f43-9a06-5d0c0884db92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:56.951521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f5fb8-40d3-4d5e-82a7-3e0dd58d21c0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:56.976637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 58/107] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:56.977521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e2fef-e4b6-4f43-9a06-5d0c0884db92 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:57.006908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c213-9c73-47f9-a12a-db9168057998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:57.007829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c213-9c73-47f9-a12a-db9168057998 None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.008114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c213-9c73-47f9-a12a-db9168057998 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.008390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3c213-9c73-47f9-a12a-db9168057998 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013/users/da54df780f9b46fe86e8cbde5bc268ac/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.011223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3c213-9c73-47f9-a12a-db9168057998 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b3f655528294e62a0a33ce69e504013, user_id=da54df780f9b46fe86e8cbde5bc268ac, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:57.013071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3c213-9c73-47f9-a12a-db9168057998 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:57.106294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e2fef-e4b6-4f43-9a06-5d0c0884db92 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:57.118706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 50/108] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:34:56 2022] PUT /identity/v3/projects/7b3f655528294e62a0a33ce69e504013/users/da54df780f9b46fe86e8cbde5bc268ac/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:34:57.119700 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c213-9c73-47f9-a12a-db9168057998 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:57.152151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02973b-83d1-44ae-a7cf-24b3ab43ff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:57.153825 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02973b-83d1-44ae-a7cf-24b3ab43ff11 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.155027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02973b-83d1-44ae-a7cf-24b3ab43ff11 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.155318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02973b-83d1-44ae-a7cf-24b3ab43ff11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.179056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02973b-83d1-44ae-a7cf-24b3ab43ff11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:57.194927 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-db02973b-83d1-44ae-a7cf-24b3ab43ff11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:34:57.196359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 59/109] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:34:57.197445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79ec3-b1b7-42a6-ab8a-576ff89994c5 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.197834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79ec3-b1b7-42a6-ab8a-576ff89994c5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.202544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad79ec3-b1b7-42a6-ab8a-576ff89994c5 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.202544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 60/110] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:57.206868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79ec3-b1b7-42a6-ab8a-576ff89994c5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:57.297834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3c213-9c73-47f9-a12a-db9168057998 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:57.343563 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60564a05-8da2-41ac-9b31-1581f74d41e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:57.344364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60564a05-8da2-41ac-9b31-1581f74d41e4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.344654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60564a05-8da2-41ac-9b31-1581f74d41e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.344931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60564a05-8da2-41ac-9b31-1581f74d41e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.363929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60564a05-8da2-41ac-9b31-1581f74d41e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:57.374573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-60564a05-8da2-41ac-9b31-1581f74d41e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:34:57.374573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 51/111] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:34:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:34:57.375732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821ec19-7f48-4766-bfba-b25984a19ac6 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.376074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821ec19-7f48-4766-bfba-b25984a19ac6 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.379748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821ec19-7f48-4766-bfba-b25984a19ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.397747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1821ec19-7f48-4766-bfba-b25984a19ac6 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:57.398516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad79ec3-b1b7-42a6-ab8a-576ff89994c5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:57.399096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1821ec19-7f48-4766-bfba-b25984a19ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:57.433316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ddf13-147e-4da2-9197-58f7be4330db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:57.434000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ddf13-147e-4da2-9197-58f7be4330db None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.434300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ddf13-147e-4da2-9197-58f7be4330db None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.434579 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ddf13-147e-4da2-9197-58f7be4330db None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.435336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ddf13-147e-4da2-9197-58f7be4330db None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:57.435645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ddf13-147e-4da2-9197-58f7be4330db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:57.437097 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ddf13-147e-4da2-9197-58f7be4330db None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:57.445835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 61/112] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:57.446764 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ddf13-147e-4da2-9197-58f7be4330db None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:57.495176 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 52/113] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:57.496411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821ec19-7f48-4766-bfba-b25984a19ac6 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:57.577732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ddf13-147e-4da2-9197-58f7be4330db None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:57.612513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e633cb-57f5-4976-851c-efba39ce0860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:57.613194 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e633cb-57f5-4976-851c-efba39ce0860 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.613479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e633cb-57f5-4976-851c-efba39ce0860 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.613757 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e633cb-57f5-4976-851c-efba39ce0860 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.614655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e633cb-57f5-4976-851c-efba39ce0860 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:57.614969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e633cb-57f5-4976-851c-efba39ce0860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:57.616393 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e633cb-57f5-4976-851c-efba39ce0860 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:57.624913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821ec19-7f48-4766-bfba-b25984a19ac6 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:57.626239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 62/114] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:34:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:57.627817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec993ca-bb7b-4b0e-be8e-c3d61c5ac099 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.628115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec993ca-bb7b-4b0e-be8e-c3d61c5ac099 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.628398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec993ca-bb7b-4b0e-be8e-c3d61c5ac099 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.630380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 63/115] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:57.631150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec993ca-bb7b-4b0e-be8e-c3d61c5ac099 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:57.673680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c4e04-3abf-4a36-bca0-c9a021e2c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:57.674603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c4e04-3abf-4a36-bca0-c9a021e2c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.674880 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c4e04-3abf-4a36-bca0-c9a021e2c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.675151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c4e04-3abf-4a36-bca0-c9a021e2c1f3 None admin] PATH_INFO: `/v3/users/3a718f2072b24450a97264ccf1958236` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.676360 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c4e04-3abf-4a36-bca0-c9a021e2c1f3 None admin] RBAC: Authorizing `identity:get_user(user_id=3a718f2072b24450a97264ccf1958236)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:57.677831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c4e04-3abf-4a36-bca0-c9a021e2c1f3 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:57.679520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 53/116] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:57 2022] GET /identity/v3/users/3a718f2072b24450a97264ccf1958236 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:57.680286 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c4e04-3abf-4a36-bca0-c9a021e2c1f3 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:57.743209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec993ca-bb7b-4b0e-be8e-c3d61c5ac099 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:57.777984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d4685-e5ad-4e44-afd7-73ef11173335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:57.779009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d4685-e5ad-4e44-afd7-73ef11173335 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.779298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d4685-e5ad-4e44-afd7-73ef11173335 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.779575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d4685-e5ad-4e44-afd7-73ef11173335 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.788035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c4e04-3abf-4a36-bca0-c9a021e2c1f3 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:57.789298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d4685-e5ad-4e44-afd7-73ef11173335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:57.797025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a77d4685-e5ad-4e44-afd7-73ef11173335 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 21:34:57.798249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 64/117] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:34:57.799495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d4a8d-8ec1-4910-93db-4ba2f68c0633 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.799788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d4a8d-8ec1-4910-93db-4ba2f68c0633 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.800065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d4a8d-8ec1-4910-93db-4ba2f68c0633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.817850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ba5d4a8d-8ec1-4910-93db-4ba2f68c0633 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:57.820239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ba5d4a8d-8ec1-4910-93db-4ba2f68c0633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:57.831474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090e162-a7c8-4d01-96b0-12c1507ffe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:57.832354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090e162-a7c8-4d01-96b0-12c1507ffe47 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.832635 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090e162-a7c8-4d01-96b0-12c1507ffe47 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.832912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090e162-a7c8-4d01-96b0-12c1507ffe47 None admin] PATH_INFO: `/v3/users/da54df780f9b46fe86e8cbde5bc268ac` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.834379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090e162-a7c8-4d01-96b0-12c1507ffe47 None admin] RBAC: Authorizing `identity:get_user(user_id=da54df780f9b46fe86e8cbde5bc268ac)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:57.835821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090e162-a7c8-4d01-96b0-12c1507ffe47 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:57.837428 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 54/118] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:57 2022] GET /identity/v3/users/da54df780f9b46fe86e8cbde5bc268ac => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:57.842179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc34ecf-ae4d-4056-92af-57d50f6006bd None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:57.842179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc34ecf-ae4d-4056-92af-57d50f6006bd None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:57.842179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc34ecf-ae4d-4056-92af-57d50f6006bd None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:57.842179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 55/119] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:57.846317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc34ecf-ae4d-4056-92af-57d50f6006bd None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:57.917400 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 65/120] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:57.918208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d4a8d-8ec1-4910-93db-4ba2f68c0633 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:57.996797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc34ecf-ae4d-4056-92af-57d50f6006bd None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:58.016846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d4a8d-8ec1-4910-93db-4ba2f68c0633 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:58.031174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e69c1d-b95a-4b37-a503-60423eeb5ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:58.032189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e69c1d-b95a-4b37-a503-60423eeb5ff9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.032472 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e69c1d-b95a-4b37-a503-60423eeb5ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.032743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e69c1d-b95a-4b37-a503-60423eeb5ff9 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:58.033920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e69c1d-b95a-4b37-a503-60423eeb5ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:58.035389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e69c1d-b95a-4b37-a503-60423eeb5ff9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:58.041593 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 56/121] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:34:57 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:58.041593 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e69c1d-b95a-4b37-a503-60423eeb5ff9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:58.050326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc124-95a8-4a14-a2ef-409af364d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:58.050995 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc124-95a8-4a14-a2ef-409af364d24f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.051276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc124-95a8-4a14-a2ef-409af364d24f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.051552 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc124-95a8-4a14-a2ef-409af364d24f None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:58.052293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dc124-95a8-4a14-a2ef-409af364d24f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:58.052607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dc124-95a8-4a14-a2ef-409af364d24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:58.054103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dc124-95a8-4a14-a2ef-409af364d24f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:58.062907 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 66/122] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:34:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:58.064155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25185b84-d3c3-4f60-a733-b4bc7060b59a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.064440 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25185b84-d3c3-4f60-a733-b4bc7060b59a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.064718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25185b84-d3c3-4f60-a733-b4bc7060b59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:58.082068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-25185b84-d3c3-4f60-a733-b4bc7060b59a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:58.083234 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-25185b84-d3c3-4f60-a733-b4bc7060b59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:58.149068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e69c1d-b95a-4b37-a503-60423eeb5ff9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:58.152229 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 67/123] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:58.154253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25185b84-d3c3-4f60-a733-b4bc7060b59a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:58.182808 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967adae2-f4ec-4f09-bd2a-25c534785ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:58.184004 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967adae2-f4ec-4f09-bd2a-25c534785ca5 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.184486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967adae2-f4ec-4f09-bd2a-25c534785ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.184987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967adae2-f4ec-4f09-bd2a-25c534785ca5 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:58.186415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967adae2-f4ec-4f09-bd2a-25c534785ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:58.188074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967adae2-f4ec-4f09-bd2a-25c534785ca5 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:58.190014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 57/124] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:34:58 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:58.194988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967adae2-f4ec-4f09-bd2a-25c534785ca5 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:58.262695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25185b84-d3c3-4f60-a733-b4bc7060b59a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:58.296093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e9909-cc22-4e3a-af6f-a1d2fb10b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:58.296821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e9909-cc22-4e3a-af6f-a1d2fb10b6c8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.297102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e9909-cc22-4e3a-af6f-a1d2fb10b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.297374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e9909-cc22-4e3a-af6f-a1d2fb10b6c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:58.299125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967adae2-f4ec-4f09-bd2a-25c534785ca5 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:58.307959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e9909-cc22-4e3a-af6f-a1d2fb10b6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:34:58.314994 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-f12e9909-cc22-4e3a-af6f-a1d2fb10b6c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:34:58.316211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 68/125] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:34:58.316983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e9909-cc22-4e3a-af6f-a1d2fb10b6c8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:58.339072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a74397-b272-489e-a66c-09f0ec461e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:58.339995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a74397-b272-489e-a66c-09f0ec461e40 None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.340274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a74397-b272-489e-a66c-09f0ec461e40 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.340545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a74397-b272-489e-a66c-09f0ec461e40 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013/users/3a718f2072b24450a97264ccf1958236/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:58.342532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a74397-b272-489e-a66c-09f0ec461e40 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b3f655528294e62a0a33ce69e504013, user_id=3a718f2072b24450a97264ccf1958236, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:58.344045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a74397-b272-489e-a66c-09f0ec461e40 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:58.418812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e9909-cc22-4e3a-af6f-a1d2fb10b6c8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:58.451876 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aab1b8-91f9-4a74-830b-b3b1d9a22d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:58.452752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aab1b8-91f9-4a74-830b-b3b1d9a22d8f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.453031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aab1b8-91f9-4a74-830b-b3b1d9a22d8f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.453418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aab1b8-91f9-4a74-830b-b3b1d9a22d8f None admin] PATH_INFO: `/v3/users/067e9e150804421ea1f13ffa237d2622` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:58.458063 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 58/126] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:34:58 2022] PUT /identity/v3/projects/7b3f655528294e62a0a33ce69e504013/users/3a718f2072b24450a97264ccf1958236/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:34:58.459224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a74397-b272-489e-a66c-09f0ec461e40 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:58.475915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aab1b8-91f9-4a74-830b-b3b1d9a22d8f None admin] RBAC: Authorizing `identity:get_user(user_id=067e9e150804421ea1f13ffa237d2622)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:58.477353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aab1b8-91f9-4a74-830b-b3b1d9a22d8f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:58.480124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 69/127] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:58 2022] GET /identity/v3/users/067e9e150804421ea1f13ffa237d2622 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:58.480762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aab1b8-91f9-4a74-830b-b3b1d9a22d8f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:58.578010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a74397-b272-489e-a66c-09f0ec461e40 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:58.584260 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aab1b8-91f9-4a74-830b-b3b1d9a22d8f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:58.616202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f122168-eb32-4025-b950-8c5e1d07fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:58.618078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f122168-eb32-4025-b950-8c5e1d07fe7d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.618738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f122168-eb32-4025-b950-8c5e1d07fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.619281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f122168-eb32-4025-b950-8c5e1d07fe7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:58.621445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f122168-eb32-4025-b950-8c5e1d07fe7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:58.623654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f122168-eb32-4025-b950-8c5e1d07fe7d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:58.626390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 59/128] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:34:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:58.627573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f122168-eb32-4025-b950-8c5e1d07fe7d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:58.629735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc902-95fd-4e6f-b2c9-e73f0f10b0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:58.631230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc902-95fd-4e6f-b2c9-e73f0f10b0a4 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.631604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc902-95fd-4e6f-b2c9-e73f0f10b0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.632895 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc902-95fd-4e6f-b2c9-e73f0f10b0a4 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013/users/da54df780f9b46fe86e8cbde5bc268ac/roles/e83d49af62db4f4aa2dcadb10a82bfdc` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:58.635483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dc902-95fd-4e6f-b2c9-e73f0f10b0a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b3f655528294e62a0a33ce69e504013, user_id=da54df780f9b46fe86e8cbde5bc268ac, role_id=e83d49af62db4f4aa2dcadb10a82bfdc)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:58.637307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dc902-95fd-4e6f-b2c9-e73f0f10b0a4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:58.710194 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 70/129] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:34:58 2022] PUT /identity/v3/projects/7b3f655528294e62a0a33ce69e504013/users/da54df780f9b46fe86e8cbde5bc268ac/roles/e83d49af62db4f4aa2dcadb10a82bfdc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:34:58.714899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc902-95fd-4e6f-b2c9-e73f0f10b0a4 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:58.735817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f122168-eb32-4025-b950-8c5e1d07fe7d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:58.780839 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c004e8a-97fd-4e79-92fa-726657c26939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:58.781598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c004e8a-97fd-4e79-92fa-726657c26939 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.781891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c004e8a-97fd-4e79-92fa-726657c26939 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.782191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c004e8a-97fd-4e79-92fa-726657c26939 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:58.783620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c004e8a-97fd-4e79-92fa-726657c26939 None admin] RBAC: Adding query filter params (name=member) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:58.783927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c004e8a-97fd-4e79-92fa-726657c26939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:58.788051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c004e8a-97fd-4e79-92fa-726657c26939 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:58.802036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 60/130] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:34:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:58.802935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c004e8a-97fd-4e79-92fa-726657c26939 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:58.951719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc902-95fd-4e6f-b2c9-e73f0f10b0a4 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:58.997965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4194e81-adc5-4571-be87-1912a80f5270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:58.998721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4194e81-adc5-4571-be87-1912a80f5270 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:58.999005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4194e81-adc5-4571-be87-1912a80f5270 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:58.999279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4194e81-adc5-4571-be87-1912a80f5270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:59.005177 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c004e8a-97fd-4e79-92fa-726657c26939 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:59.038656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a507427-e4ab-445f-a971-e089daf0ba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:59.039320 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a507427-e4ab-445f-a971-e089daf0ba34 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:59.039603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a507427-e4ab-445f-a971-e089daf0ba34 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:59.039876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a507427-e4ab-445f-a971-e089daf0ba34 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:59.040583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a507427-e4ab-445f-a971-e089daf0ba34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:59.043544 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a507427-e4ab-445f-a971-e089daf0ba34 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:59.068677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4194e81-adc5-4571-be87-1912a80f5270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:59.070181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4194e81-adc5-4571-be87-1912a80f5270 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:59.131925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 61/131] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:34:58 2022] POST /identity/v3/projects => generated 302 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:34:59.138718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a507427-e4ab-445f-a971-e089daf0ba34 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:59.174030 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 71/132] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:34:59.179646 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4194e81-adc5-4571-be87-1912a80f5270 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:59.286516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4194e81-adc5-4571-be87-1912a80f5270 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:59.321829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449c71-5045-4444-8acb-85092188962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:59.323281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449c71-5045-4444-8acb-85092188962a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:59.323559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449c71-5045-4444-8acb-85092188962a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:59.323873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449c71-5045-4444-8acb-85092188962a None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:59.325247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449c71-5045-4444-8acb-85092188962a None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:59.326871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449c71-5045-4444-8acb-85092188962a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:59.328855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 72/133] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:34:59 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:59.334415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449c71-5045-4444-8acb-85092188962a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:59.392921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a507427-e4ab-445f-a971-e089daf0ba34 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:59.447155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc08fae-d4d3-40c4-be9b-3ce6ee979598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:59.448479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08fae-d4d3-40c4-be9b-3ce6ee979598 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:59.449029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08fae-d4d3-40c4-be9b-3ce6ee979598 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:59.449500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc08fae-d4d3-40c4-be9b-3ce6ee979598 None admin] PATH_INFO: `/v3/users/da54df780f9b46fe86e8cbde5bc268ac` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:59.453881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc08fae-d4d3-40c4-be9b-3ce6ee979598 None admin] RBAC: Authorizing `identity:get_user(user_id=da54df780f9b46fe86e8cbde5bc268ac)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:59.455640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc08fae-d4d3-40c4-be9b-3ce6ee979598 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:59.457530 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 62/134] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:34:59 2022] GET /identity/v3/users/da54df780f9b46fe86e8cbde5bc268ac => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:34:59.462979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc08fae-d4d3-40c4-be9b-3ce6ee979598 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:59.470935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449c71-5045-4444-8acb-85092188962a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:59.506131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a80f6-0c42-4877-a82e-3ed30f262928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:59.506768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a80f6-0c42-4877-a82e-3ed30f262928 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:59.507057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a80f6-0c42-4877-a82e-3ed30f262928 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:59.507337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a80f6-0c42-4877-a82e-3ed30f262928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:59.508247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a80f6-0c42-4877-a82e-3ed30f262928 None admin] RBAC: Adding query filter params (role.id=2151a047bd9744e5be942a6bbd8c0f28, scope.project.id=7b3f655528294e62a0a33ce69e504013, user.id=067e9e150804421ea1f13ffa237d2622) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:34:59.508563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a80f6-0c42-4877-a82e-3ed30f262928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:59.514015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a80f6-0c42-4877-a82e-3ed30f262928 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:59.516728 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 73/135] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:34:59 2022] GET /identity/v3/role_assignments?user.id=067e9e150804421ea1f13ffa237d2622&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=2151a047bd9744e5be942a6bbd8c0f28 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:59.607652 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc08fae-d4d3-40c4-be9b-3ce6ee979598 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:59.649269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9bc8a-9819-4815-beed-7abb0e2a4669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:59.650542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9bc8a-9819-4815-beed-7abb0e2a4669 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:59.651810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9bc8a-9819-4815-beed-7abb0e2a4669 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:59.652448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9bc8a-9819-4815-beed-7abb0e2a4669 None admin] PATH_INFO: `/v3/projects/05e3ffaf21b14ae8810a7f8127490ed8` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:59.654867 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9bc8a-9819-4815-beed-7abb0e2a4669 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3ffaf21b14ae8810a7f8127490ed8)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:59.656618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9bc8a-9819-4815-beed-7abb0e2a4669 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:34:59.658677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 63/136] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:34:59 2022] GET /identity/v3/projects/05e3ffaf21b14ae8810a7f8127490ed8 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:34:59.664794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a80f6-0c42-4877-a82e-3ed30f262928 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:59.726225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6d4b2-5df7-4470-99a0-8888ad2f4bbc None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:59.726855 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6d4b2-5df7-4470-99a0-8888ad2f4bbc None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:59.727351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6d4b2-5df7-4470-99a0-8888ad2f4bbc None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:59.729856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 64/137] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:34:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:34:59.740350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316de021-db16-42dd-adae-c4236eb34528 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:59.740962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316de021-db16-42dd-adae-c4236eb34528 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:59.741442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316de021-db16-42dd-adae-c4236eb34528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:59.775040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-316de021-db16-42dd-adae-c4236eb34528 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:34:59.776649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-316de021-db16-42dd-adae-c4236eb34528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:34:59.862321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a80f6-0c42-4877-a82e-3ed30f262928 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:34:59.876755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 65/138] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:34:59.918238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2444e-7d99-4c6a-90bb-5022d9e8f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:34:59.919587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316de021-db16-42dd-adae-c4236eb34528 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:34:59.930537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2444e-7d99-4c6a-90bb-5022d9e8f972 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:34:59.930818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2444e-7d99-4c6a-90bb-5022d9e8f972 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:34:59.931133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2444e-7d99-4c6a-90bb-5022d9e8f972 None admin] PATH_INFO: `/v3/projects/05e3ffaf21b14ae8810a7f8127490ed8/users/da54df780f9b46fe86e8cbde5bc268ac/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:34:59.941565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2444e-7d99-4c6a-90bb-5022d9e8f972 None admin] RBAC: Authorizing `identity:create_grant(project_id=05e3ffaf21b14ae8810a7f8127490ed8, user_id=da54df780f9b46fe86e8cbde5bc268ac, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:34:59.943072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2444e-7d99-4c6a-90bb-5022d9e8f972 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:00.039581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316de021-db16-42dd-adae-c4236eb34528 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:00.044094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 74/139] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:34:59 2022] PUT /identity/v3/projects/05e3ffaf21b14ae8810a7f8127490ed8/users/da54df780f9b46fe86e8cbde5bc268ac/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:00.081462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eb5c6-0ea1-4dd3-9d0c-afd3fee043fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:00.082346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eb5c6-0ea1-4dd3-9d0c-afd3fee043fb None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:00.082637 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eb5c6-0ea1-4dd3-9d0c-afd3fee043fb None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:00.082920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60eb5c6-0ea1-4dd3-9d0c-afd3fee043fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:00.099969 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60eb5c6-0ea1-4dd3-9d0c-afd3fee043fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:00.107981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-c60eb5c6-0ea1-4dd3-9d0c-afd3fee043fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:00.109278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 66/140] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:34:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:00.115617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2444e-7d99-4c6a-90bb-5022d9e8f972 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:00.257785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2444e-7d99-4c6a-90bb-5022d9e8f972 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:00.293042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7147bd6-3e4c-4cc0-ab49-fda7a397ffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:00.294139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7147bd6-3e4c-4cc0-ab49-fda7a397ffa1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:00.294618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7147bd6-3e4c-4cc0-ab49-fda7a397ffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:00.295081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7147bd6-3e4c-4cc0-ab49-fda7a397ffa1 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:00.296029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7147bd6-3e4c-4cc0-ab49-fda7a397ffa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:00.296569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7147bd6-3e4c-4cc0-ab49-fda7a397ffa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:00.298196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7147bd6-3e4c-4cc0-ab49-fda7a397ffa1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:00.308212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 75/141] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:00.313848 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eb5c6-0ea1-4dd3-9d0c-afd3fee043fb None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:00.433766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60eb5c6-0ea1-4dd3-9d0c-afd3fee043fb None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:00.477418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b2181-08f7-4403-8ccb-fcdf5c726a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:00.478363 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2181-08f7-4403-8ccb-fcdf5c726a55 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:00.478649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2181-08f7-4403-8ccb-fcdf5c726a55 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:00.479132 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b2181-08f7-4403-8ccb-fcdf5c726a55 None admin] PATH_INFO: `/v3/users/da54df780f9b46fe86e8cbde5bc268ac` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:00.480620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b2181-08f7-4403-8ccb-fcdf5c726a55 None admin] RBAC: Authorizing `identity:get_user(user_id=da54df780f9b46fe86e8cbde5bc268ac)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:00.482138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b2181-08f7-4403-8ccb-fcdf5c726a55 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:00.483819 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 67/142] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:00 2022] GET /identity/v3/users/da54df780f9b46fe86e8cbde5bc268ac => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:00.493525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7147bd6-3e4c-4cc0-ab49-fda7a397ffa1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:00.631560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7147bd6-3e4c-4cc0-ab49-fda7a397ffa1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:00.676111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5bcc-092e-4782-b15c-d56f3cf6daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:00.676781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5bcc-092e-4782-b15c-d56f3cf6daf5 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:00.677068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5bcc-092e-4782-b15c-d56f3cf6daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:00.677347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac5bcc-092e-4782-b15c-d56f3cf6daf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:00.769372 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5bcc-092e-4782-b15c-d56f3cf6daf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:00.770886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac5bcc-092e-4782-b15c-d56f3cf6daf5 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:00.935089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 76/143] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:00.941145 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b2181-08f7-4403-8ccb-fcdf5c726a55 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:01.056415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b2181-08f7-4403-8ccb-fcdf5c726a55 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:01.103319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2c8f-85fd-4549-90a7-69f7c2436e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:01.104995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2c8f-85fd-4549-90a7-69f7c2436e5f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:01.105392 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2c8f-85fd-4549-90a7-69f7c2436e5f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:01.105788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2c8f-85fd-4549-90a7-69f7c2436e5f None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:01.110748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb2c8f-85fd-4549-90a7-69f7c2436e5f None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:01.112239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb2c8f-85fd-4549-90a7-69f7c2436e5f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:01.113972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 68/144] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:00 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:01.121226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5bcc-092e-4782-b15c-d56f3cf6daf5 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:01.275999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac5bcc-092e-4782-b15c-d56f3cf6daf5 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:01.318344 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888c8c5-f832-4a87-9718-3a0abf5cad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:01.319005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888c8c5-f832-4a87-9718-3a0abf5cad2b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:01.319291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888c8c5-f832-4a87-9718-3a0abf5cad2b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:01.319569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888c8c5-f832-4a87-9718-3a0abf5cad2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:01.320401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888c8c5-f832-4a87-9718-3a0abf5cad2b None admin] RBAC: Adding query filter params (role.id=b15932e4d63b437eb478fd41d0ae6ec6, scope.project.id=7b3f655528294e62a0a33ce69e504013, user.id=da54df780f9b46fe86e8cbde5bc268ac) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:01.320713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888c8c5-f832-4a87-9718-3a0abf5cad2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:01.322181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888c8c5-f832-4a87-9718-3a0abf5cad2b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:01.328730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 77/145] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:01 2022] GET /identity/v3/role_assignments?user.id=da54df780f9b46fe86e8cbde5bc268ac&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:01.963021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5051a6-8f25-47b9-b4a6-7515dfe66f97 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:01.963519 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5051a6-8f25-47b9-b4a6-7515dfe66f97 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:01.963716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5051a6-8f25-47b9-b4a6-7515dfe66f97 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:01.965528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 69/146] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:01.970848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe157f8-2002-41d7-9212-1ed9c92a1d40 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:01.971131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe157f8-2002-41d7-9212-1ed9c92a1d40 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:01.971416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe157f8-2002-41d7-9212-1ed9c92a1d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:01.992306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2fe157f8-2002-41d7-9212-1ed9c92a1d40 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:01.993503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2fe157f8-2002-41d7-9212-1ed9c92a1d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:02.068222 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c71ad-5cc7-4386-a481-45eb34c82788 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.068836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c71ad-5cc7-4386-a481-45eb34c82788 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.068836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c71ad-5cc7-4386-a481-45eb34c82788 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.070747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 70/147] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:02.080310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d999db2-84d3-4024-9374-6aff1173cf52 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.080628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 78/148] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:02.080790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d999db2-84d3-4024-9374-6aff1173cf52 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.080998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d999db2-84d3-4024-9374-6aff1173cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.108027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-3d999db2-84d3-4024-9374-6aff1173cf52 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:02.109603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3d999db2-84d3-4024-9374-6aff1173cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:02.112676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe157f8-2002-41d7-9212-1ed9c92a1d40 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:02.215819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe157f8-2002-41d7-9212-1ed9c92a1d40 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:02.251407 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2401-85f8-46f9-94f2-8bf24155a17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:02.252207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2401-85f8-46f9-94f2-8bf24155a17e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.252489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2401-85f8-46f9-94f2-8bf24155a17e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.252765 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e2401-85f8-46f9-94f2-8bf24155a17e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.253039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 71/149] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:02.274991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e2401-85f8-46f9-94f2-8bf24155a17e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:02.286819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-c63e2401-85f8-46f9-94f2-8bf24155a17e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:35:02.288134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 79/150] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:02.294815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d999db2-84d3-4024-9374-6aff1173cf52 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:02.297658 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2401-85f8-46f9-94f2-8bf24155a17e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:02.401886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e2401-85f8-46f9-94f2-8bf24155a17e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:02.435865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fa245-673e-4074-8422-a4ddeec58368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:02.436685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fa245-673e-4074-8422-a4ddeec58368 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.436982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fa245-673e-4074-8422-a4ddeec58368 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.437254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fa245-673e-4074-8422-a4ddeec58368 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.448188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fa245-673e-4074-8422-a4ddeec58368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:02.455649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-af4fa245-673e-4074-8422-a4ddeec58368 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:02.456862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 80/151] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:02.462586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fa245-673e-4074-8422-a4ddeec58368 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:02.482896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d999db2-84d3-4024-9374-6aff1173cf52 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:02.547281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee2fe0-1713-48ed-8ba6-a80c6c743267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:02.547979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee2fe0-1713-48ed-8ba6-a80c6c743267 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.548263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee2fe0-1713-48ed-8ba6-a80c6c743267 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.548543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee2fe0-1713-48ed-8ba6-a80c6c743267 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.549302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee2fe0-1713-48ed-8ba6-a80c6c743267 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:02.549605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee2fe0-1713-48ed-8ba6-a80c6c743267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:02.551014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee2fe0-1713-48ed-8ba6-a80c6c743267 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:02.560006 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 72/152] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:02.562041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fa245-673e-4074-8422-a4ddeec58368 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:02.570998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee2fe0-1713-48ed-8ba6-a80c6c743267 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:02.596106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1b2f6-c7bd-43de-996a-9bb98e7d9307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:02.596780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b2f6-c7bd-43de-996a-9bb98e7d9307 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.597062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b2f6-c7bd-43de-996a-9bb98e7d9307 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.597335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1b2f6-c7bd-43de-996a-9bb98e7d9307 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.598107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1b2f6-c7bd-43de-996a-9bb98e7d9307 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:02.598416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1b2f6-c7bd-43de-996a-9bb98e7d9307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:02.599786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1b2f6-c7bd-43de-996a-9bb98e7d9307 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:02.608500 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 81/153] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:02.613826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1b2f6-c7bd-43de-996a-9bb98e7d9307 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:02.721230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee2fe0-1713-48ed-8ba6-a80c6c743267 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:02.722498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1b2f6-c7bd-43de-996a-9bb98e7d9307 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:02.756165 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c50dc-c028-4e72-b6fd-8286ba94bb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:02.756975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceffcc4-477e-444e-a22b-3bb15bca2f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:02.757092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c50dc-c028-4e72-b6fd-8286ba94bb7e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.757306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c50dc-c028-4e72-b6fd-8286ba94bb7e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.757580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c50dc-c028-4e72-b6fd-8286ba94bb7e None admin] PATH_INFO: `/v3/users/da54df780f9b46fe86e8cbde5bc268ac` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.758659 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceffcc4-477e-444e-a22b-3bb15bca2f63 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.758844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c50dc-c028-4e72-b6fd-8286ba94bb7e None admin] RBAC: Authorizing `identity:get_user(user_id=da54df780f9b46fe86e8cbde5bc268ac)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:02.759359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceffcc4-477e-444e-a22b-3bb15bca2f63 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.759843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceffcc4-477e-444e-a22b-3bb15bca2f63 None admin] PATH_INFO: `/v3/users/3a718f2072b24450a97264ccf1958236` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.760526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c50dc-c028-4e72-b6fd-8286ba94bb7e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:02.761824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceffcc4-477e-444e-a22b-3bb15bca2f63 None admin] RBAC: Authorizing `identity:get_user(user_id=3a718f2072b24450a97264ccf1958236)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:02.762628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 82/154] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:02 2022] GET /identity/v3/users/da54df780f9b46fe86e8cbde5bc268ac => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:02.763690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3a38-db3a-4950-bb3b-fa2cab864fd1 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.763972 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3a38-db3a-4950-bb3b-fa2cab864fd1 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.764248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd3a38-db3a-4950-bb3b-fa2cab864fd1 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.764587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceffcc4-477e-444e-a22b-3bb15bca2f63 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:02.765884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 83/155] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:02.771395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 73/156] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:02 2022] GET /identity/v3/users/3a718f2072b24450a97264ccf1958236 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:02.771607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791a19-5946-4090-ae3d-e39dd0c1b702 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.771871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791a19-5946-4090-ae3d-e39dd0c1b702 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.772151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791a19-5946-4090-ae3d-e39dd0c1b702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.773015 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceffcc4-477e-444e-a22b-3bb15bca2f63 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:02.788917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-93791a19-5946-4090-ae3d-e39dd0c1b702 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:02.790144 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-93791a19-5946-4090-ae3d-e39dd0c1b702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:02.860646 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 84/157] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:02.861651 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93791a19-5946-4090-ae3d-e39dd0c1b702 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:02.893758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceffcc4-477e-444e-a22b-3bb15bca2f63 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:02.929570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e9cb0-eae3-4e07-b417-01812e3e2747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:02.930410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e9cb0-eae3-4e07-b417-01812e3e2747 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.930766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e9cb0-eae3-4e07-b417-01812e3e2747 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.931122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e9cb0-eae3-4e07-b417-01812e3e2747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.961313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93791a19-5946-4090-ae3d-e39dd0c1b702 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:02.994529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7140a0-0e53-4037-b671-86bb222324da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:02.995247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7140a0-0e53-4037-b671-86bb222324da None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:02.995619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7140a0-0e53-4037-b671-86bb222324da None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:02.995985 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7140a0-0e53-4037-b671-86bb222324da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:02.998492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e9cb0-eae3-4e07-b417-01812e3e2747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:03.000060 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e9cb0-eae3-4e07-b417-01812e3e2747 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:03.064649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7140a0-0e53-4037-b671-86bb222324da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:03.066394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7140a0-0e53-4037-b671-86bb222324da None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:03.097282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 74/158] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:03.098488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd904e8-d53a-4804-b4e6-147c5deeae23 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.098773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd904e8-d53a-4804-b4e6-147c5deeae23 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.099045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd904e8-d53a-4804-b4e6-147c5deeae23 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.102274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 75/159] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:03.102274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd904e8-d53a-4804-b4e6-147c5deeae23 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:03.168182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 85/160] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:03.169104 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7140a0-0e53-4037-b671-86bb222324da None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:03.210687 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd904e8-d53a-4804-b4e6-147c5deeae23 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:03.244069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88a72a-c1cb-4d28-b37f-3fb52c4cbf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:03.245426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88a72a-c1cb-4d28-b37f-3fb52c4cbf4d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.245905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88a72a-c1cb-4d28-b37f-3fb52c4cbf4d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.245905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88a72a-c1cb-4d28-b37f-3fb52c4cbf4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.255784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88a72a-c1cb-4d28-b37f-3fb52c4cbf4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:03.264063 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-2e88a72a-c1cb-4d28-b37f-3fb52c4cbf4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 21:35:03.270071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 76/161] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:03.270071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b02fa-1135-4132-a076-829327452935 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.270272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7140a0-0e53-4037-b671-86bb222324da None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:03.270939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b02fa-1135-4132-a076-829327452935 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.270939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b02fa-1135-4132-a076-829327452935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.289025 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8a6b02fa-1135-4132-a076-829327452935 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:03.290236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8a6b02fa-1135-4132-a076-829327452935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:03.303321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05583f46-9b09-4d2d-9d04-6993283ba63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:03.304175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05583f46-9b09-4d2d-9d04-6993283ba63e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.304452 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05583f46-9b09-4d2d-9d04-6993283ba63e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.304724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05583f46-9b09-4d2d-9d04-6993283ba63e None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.305894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05583f46-9b09-4d2d-9d04-6993283ba63e None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:03.307927 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05583f46-9b09-4d2d-9d04-6993283ba63e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:03.314368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 86/162] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:03 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:03.314368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05583f46-9b09-4d2d-9d04-6993283ba63e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:03.368455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 77/163] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:03.369892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b02fa-1135-4132-a076-829327452935 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:03.429623 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05583f46-9b09-4d2d-9d04-6993283ba63e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:03.463909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad9589-bd64-4c20-9c70-f1ce3be4d7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:03.464764 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad9589-bd64-4c20-9c70-f1ce3be4d7ba None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.465031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad9589-bd64-4c20-9c70-f1ce3be4d7ba None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.465298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad9589-bd64-4c20-9c70-f1ce3be4d7ba None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.466516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad9589-bd64-4c20-9c70-f1ce3be4d7ba None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:03.467576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b02fa-1135-4132-a076-829327452935 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:03.467957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad9589-bd64-4c20-9c70-f1ce3be4d7ba None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:03.469630 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 87/164] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:03 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:03.475067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad9589-bd64-4c20-9c70-f1ce3be4d7ba None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:03.503703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d20788-48a2-471e-af06-ad5105260def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:03.504280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20788-48a2-471e-af06-ad5105260def None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.504554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20788-48a2-471e-af06-ad5105260def None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.504823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20788-48a2-471e-af06-ad5105260def None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.505567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d20788-48a2-471e-af06-ad5105260def None admin] RBAC: Adding query filter params (name=reader) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:03.505872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d20788-48a2-471e-af06-ad5105260def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:03.507268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d20788-48a2-471e-af06-ad5105260def None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:03.515712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 78/165] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:03.518907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d20788-48a2-471e-af06-ad5105260def None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:03.569495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad9589-bd64-4c20-9c70-f1ce3be4d7ba None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:03.600613 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d7b0f-226f-4ee9-a2bf-79cc0c0e7e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:03.601244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d7b0f-226f-4ee9-a2bf-79cc0c0e7e3a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.601520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d7b0f-226f-4ee9-a2bf-79cc0c0e7e3a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.601788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d7b0f-226f-4ee9-a2bf-79cc0c0e7e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.602633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d7b0f-226f-4ee9-a2bf-79cc0c0e7e3a None admin] RBAC: Adding query filter params (role.id=e83d49af62db4f4aa2dcadb10a82bfdc, scope.project.id=7b3f655528294e62a0a33ce69e504013, user.id=da54df780f9b46fe86e8cbde5bc268ac) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:03.602936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d7b0f-226f-4ee9-a2bf-79cc0c0e7e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:03.605271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d7b0f-226f-4ee9-a2bf-79cc0c0e7e3a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:03.610808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 88/166] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:03 2022] GET /identity/v3/role_assignments?user.id=da54df780f9b46fe86e8cbde5bc268ac&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=e83d49af62db4f4aa2dcadb10a82bfdc => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:03.610808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d7b0f-226f-4ee9-a2bf-79cc0c0e7e3a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:03.622383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d20788-48a2-471e-af06-ad5105260def None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:03.649566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d68da-0e6b-406a-9771-3c2a8a4a7ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:03.650457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d68da-0e6b-406a-9771-3c2a8a4a7ae4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.651292 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d68da-0e6b-406a-9771-3c2a8a4a7ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.651574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d68da-0e6b-406a-9771-3c2a8a4a7ae4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.652884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d68da-0e6b-406a-9771-3c2a8a4a7ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:03.654394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d68da-0e6b-406a-9771-3c2a8a4a7ae4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:03.656280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 79/167] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:03.657542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288251f-a2e1-48c5-97e6-3d8927bf3032 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.657829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288251f-a2e1-48c5-97e6-3d8927bf3032 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.658130 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288251f-a2e1-48c5-97e6-3d8927bf3032 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.659981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 80/168] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:03.662282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288251f-a2e1-48c5-97e6-3d8927bf3032 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:03.724764 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d7b0f-226f-4ee9-a2bf-79cc0c0e7e3a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:03.761956 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d84ba-1fff-46a6-9aaa-93fb816a4898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:03.762571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d84ba-1fff-46a6-9aaa-93fb816a4898 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.762847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d84ba-1fff-46a6-9aaa-93fb816a4898 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.763116 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d84ba-1fff-46a6-9aaa-93fb816a4898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.763958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d84ba-1fff-46a6-9aaa-93fb816a4898 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=7b3f655528294e62a0a33ce69e504013, user.id=3a718f2072b24450a97264ccf1958236) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:03.764261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d84ba-1fff-46a6-9aaa-93fb816a4898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:03.765705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d84ba-1fff-46a6-9aaa-93fb816a4898 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:03.771151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288251f-a2e1-48c5-97e6-3d8927bf3032 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:03.772061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 89/169] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:03 2022] GET /identity/v3/role_assignments?user.id=3a718f2072b24450a97264ccf1958236&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:03.772910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d84ba-1fff-46a6-9aaa-93fb816a4898 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:03.817188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff3c55-37ac-47ec-ad8c-4d584a4d00c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:03.818840 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff3c55-37ac-47ec-ad8c-4d584a4d00c7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.819125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff3c55-37ac-47ec-ad8c-4d584a4d00c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.819402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff3c55-37ac-47ec-ad8c-4d584a4d00c7 None admin] PATH_INFO: `/v3/users/067e9e150804421ea1f13ffa237d2622` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.830188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff3c55-37ac-47ec-ad8c-4d584a4d00c7 None admin] RBAC: Authorizing `identity:get_user(user_id=067e9e150804421ea1f13ffa237d2622)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:03.830188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff3c55-37ac-47ec-ad8c-4d584a4d00c7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:03.830188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 81/170] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:03 2022] GET /identity/v3/users/067e9e150804421ea1f13ffa237d2622 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:03.830188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903240d6-bf88-4c16-8b2b-27e5ea505417 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.830188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903240d6-bf88-4c16-8b2b-27e5ea505417 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.830188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903240d6-bf88-4c16-8b2b-27e5ea505417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.852655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-903240d6-bf88-4c16-8b2b-27e5ea505417 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:03.855200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-903240d6-bf88-4c16-8b2b-27e5ea505417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:03.908330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d84ba-1fff-46a6-9aaa-93fb816a4898 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:03.946196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 82/171] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:03.948073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903240d6-bf88-4c16-8b2b-27e5ea505417 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:03.955180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450b42-fc47-498a-8616-f5b6c3ae6068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:03.955948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450b42-fc47-498a-8616-f5b6c3ae6068 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:03.956239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450b42-fc47-498a-8616-f5b6c3ae6068 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:03.956520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450b42-fc47-498a-8616-f5b6c3ae6068 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:03.957252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450b42-fc47-498a-8616-f5b6c3ae6068 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:03.959476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450b42-fc47-498a-8616-f5b6c3ae6068 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:04.048871 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903240d6-bf88-4c16-8b2b-27e5ea505417 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:04.075799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 90/172] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:35:03 2022] POST /identity/v3/users => generated 283 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:35:04.076632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450b42-fc47-498a-8616-f5b6c3ae6068 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:04.084202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf91f43-f220-4754-b15e-afd33a1e4a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:04.085101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf91f43-f220-4754-b15e-afd33a1e4a5b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:04.085378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf91f43-f220-4754-b15e-afd33a1e4a5b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:04.085654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf91f43-f220-4754-b15e-afd33a1e4a5b None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:04.086997 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf91f43-f220-4754-b15e-afd33a1e4a5b None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:04.088629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf91f43-f220-4754-b15e-afd33a1e4a5b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:04.090672 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 83/173] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:03 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:04.096339 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf91f43-f220-4754-b15e-afd33a1e4a5b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:04.190324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450b42-fc47-498a-8616-f5b6c3ae6068 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:04.200742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf91f43-f220-4754-b15e-afd33a1e4a5b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:04.229508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866ad0f-1c3b-4479-906f-ad5af5867b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:04.230391 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866ad0f-1c3b-4479-906f-ad5af5867b4b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:04.230680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866ad0f-1c3b-4479-906f-ad5af5867b4b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:04.230958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866ad0f-1c3b-4479-906f-ad5af5867b4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:04.237730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d5b0a-620b-4d78-a3ec-762d140bd95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:04.238673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d5b0a-620b-4d78-a3ec-762d140bd95b None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:04.238956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d5b0a-620b-4d78-a3ec-762d140bd95b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:04.239235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d5b0a-620b-4d78-a3ec-762d140bd95b None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013/users/067e9e150804421ea1f13ffa237d2622/roles/2151a047bd9744e5be942a6bbd8c0f28` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:04.241307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d5b0a-620b-4d78-a3ec-762d140bd95b None admin] RBAC: Authorizing `identity:create_grant(project_id=7b3f655528294e62a0a33ce69e504013, user_id=067e9e150804421ea1f13ffa237d2622, role_id=2151a047bd9744e5be942a6bbd8c0f28)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:04.242425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866ad0f-1c3b-4479-906f-ad5af5867b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:04.242830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d5b0a-620b-4d78-a3ec-762d140bd95b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:04.250971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-2866ad0f-1c3b-4479-906f-ad5af5867b4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:04.252355 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 91/174] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:04.257925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866ad0f-1c3b-4479-906f-ad5af5867b4b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:04.298511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 84/175] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:35:04 2022] PUT /identity/v3/projects/7b3f655528294e62a0a33ce69e504013/users/067e9e150804421ea1f13ffa237d2622/roles/2151a047bd9744e5be942a6bbd8c0f28 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:35:04.370813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866ad0f-1c3b-4479-906f-ad5af5867b4b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:04.414516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4c354-5559-42b0-a789-e04a1377c7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:04.415215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4c354-5559-42b0-a789-e04a1377c7d6 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:04.415500 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4c354-5559-42b0-a789-e04a1377c7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:04.415780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4c354-5559-42b0-a789-e04a1377c7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:04.417083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4c354-5559-42b0-a789-e04a1377c7d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:04.417389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4c354-5559-42b0-a789-e04a1377c7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:04.418877 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4c354-5559-42b0-a789-e04a1377c7d6 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:04.429071 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 92/176] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:04.435692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d5b0a-620b-4d78-a3ec-762d140bd95b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:04.546795 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d5b0a-620b-4d78-a3ec-762d140bd95b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:04.583326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbb166-db4d-477e-a20a-4d8fa19fec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:04.584208 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb166-db4d-477e-a20a-4d8fa19fec80 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:04.584489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb166-db4d-477e-a20a-4d8fa19fec80 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:04.584760 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb166-db4d-477e-a20a-4d8fa19fec80 None admin] PATH_INFO: `/v3/users/da54df780f9b46fe86e8cbde5bc268ac` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:04.586053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbb166-db4d-477e-a20a-4d8fa19fec80 None admin] RBAC: Authorizing `identity:get_user(user_id=da54df780f9b46fe86e8cbde5bc268ac)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:04.587620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbb166-db4d-477e-a20a-4d8fa19fec80 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:04.590315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 85/177] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:04 2022] GET /identity/v3/users/da54df780f9b46fe86e8cbde5bc268ac => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:04.595619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4c354-5559-42b0-a789-e04a1377c7d6 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:04.706555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4c354-5559-42b0-a789-e04a1377c7d6 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:04.739424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c3696-43e5-48f5-ac9b-4a72fc058741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:04.740085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c3696-43e5-48f5-ac9b-4a72fc058741 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:04.740364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c3696-43e5-48f5-ac9b-4a72fc058741 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:04.740640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c3696-43e5-48f5-ac9b-4a72fc058741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:04.809470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c3696-43e5-48f5-ac9b-4a72fc058741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:04.811031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c3696-43e5-48f5-ac9b-4a72fc058741 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:04.913946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 93/178] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:04.920201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbb166-db4d-477e-a20a-4d8fa19fec80 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:05.023098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbb166-db4d-477e-a20a-4d8fa19fec80 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:05.058361 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bce472-f42a-4024-b259-b978b8962e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:05.059280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce472-f42a-4024-b259-b978b8962e54 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:05.059569 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce472-f42a-4024-b259-b978b8962e54 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:05.059943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce472-f42a-4024-b259-b978b8962e54 None admin] PATH_INFO: `/v3/projects/05e3ffaf21b14ae8810a7f8127490ed8` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:05.061149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bce472-f42a-4024-b259-b978b8962e54 None admin] RBAC: Authorizing `identity:get_project(project_id=05e3ffaf21b14ae8810a7f8127490ed8)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:05.062627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bce472-f42a-4024-b259-b978b8962e54 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:05.064559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 86/179] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:04 2022] GET /identity/v3/projects/05e3ffaf21b14ae8810a7f8127490ed8 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:05.070183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c3696-43e5-48f5-ac9b-4a72fc058741 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:05.171862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c3696-43e5-48f5-ac9b-4a72fc058741 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:05.207002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125ca1c-3b7f-49e5-a845-68c5425d01b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:05.207668 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ca1c-3b7f-49e5-a845-68c5425d01b1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:05.207949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ca1c-3b7f-49e5-a845-68c5425d01b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:05.208223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125ca1c-3b7f-49e5-a845-68c5425d01b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:05.209055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ca1c-3b7f-49e5-a845-68c5425d01b1 None admin] RBAC: Adding query filter params (role.id=b15932e4d63b437eb478fd41d0ae6ec6, scope.project.id=05e3ffaf21b14ae8810a7f8127490ed8, user.id=da54df780f9b46fe86e8cbde5bc268ac) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:05.209360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ca1c-3b7f-49e5-a845-68c5425d01b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:05.210831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125ca1c-3b7f-49e5-a845-68c5425d01b1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:05.216899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 94/180] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:05 2022] GET /identity/v3/role_assignments?user.id=da54df780f9b46fe86e8cbde5bc268ac&scope.project.id=05e3ffaf21b14ae8810a7f8127490ed8&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:06.727957 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c0315-3ecf-4d31-b0e2-6a094c7db4b3 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:06.729169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c0315-3ecf-4d31-b0e2-6a094c7db4b3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:06.729333 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c0315-3ecf-4d31-b0e2-6a094c7db4b3 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:06.731123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 87/181] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:06.736863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d826-5c69-4785-9b65-ae8a479681de None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:06.737700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d826-5c69-4785-9b65-ae8a479681de None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:06.738271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d826-5c69-4785-9b65-ae8a479681de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:06.755583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-11f4d826-5c69-4785-9b65-ae8a479681de None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:06.757075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-11f4d826-5c69-4785-9b65-ae8a479681de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:06.801254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbd10d-5266-40df-b0b2-e91303ad0fb0 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:06.801254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbd10d-5266-40df-b0b2-e91303ad0fb0 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:06.801254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbd10d-5266-40df-b0b2-e91303ad0fb0 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:06.801254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 88/182] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:06.807816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c530d-8fb2-4266-9ffa-39fcb98bffe1 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:06.808337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c530d-8fb2-4266-9ffa-39fcb98bffe1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:06.808804 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c530d-8fb2-4266-9ffa-39fcb98bffe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:06.826620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-740c530d-8fb2-4266-9ffa-39fcb98bffe1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:06.828096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-740c530d-8fb2-4266-9ffa-39fcb98bffe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:06.831083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 95/183] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:06.860309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d826-5c69-4785-9b65-ae8a479681de None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:06.903207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 89/184] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:06.926427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c530d-8fb2-4266-9ffa-39fcb98bffe1 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:06.964249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d826-5c69-4785-9b65-ae8a479681de None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:06.999455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df8528-6833-4078-a1c6-1f00606703be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.000488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8528-6833-4078-a1c6-1f00606703be None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.000903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8528-6833-4078-a1c6-1f00606703be None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.001307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8528-6833-4078-a1c6-1f00606703be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.012550 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df8528-6833-4078-a1c6-1f00606703be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:07.019708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a4df8528-6833-4078-a1c6-1f00606703be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:35:07.021084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 96/185] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:35:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:07.028317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c530d-8fb2-4266-9ffa-39fcb98bffe1 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:07.032521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df8528-6833-4078-a1c6-1f00606703be None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:07.064549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a445d4-84bb-4088-bc93-0b8dfe827a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.065646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a445d4-84bb-4088-bc93-0b8dfe827a09 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.066002 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a445d4-84bb-4088-bc93-0b8dfe827a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.066294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a445d4-84bb-4088-bc93-0b8dfe827a09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.076664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a445d4-84bb-4088-bc93-0b8dfe827a09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:07.083698 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-a5a445d4-84bb-4088-bc93-0b8dfe827a09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 21:35:07.085071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 90/186] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:07.087304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd274-dd63-477a-8240-3f61400ac999 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.088298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd274-dd63-477a-8240-3f61400ac999 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.089016 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd274-dd63-477a-8240-3f61400ac999 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.091467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 91/187] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:07.092599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacd274-dd63-477a-8240-3f61400ac999 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:07.138093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df8528-6833-4078-a1c6-1f00606703be None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:07.172798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a96772-2e82-4c75-9e57-3941e6fb7dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.173473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a96772-2e82-4c75-9e57-3941e6fb7dad None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.173763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a96772-2e82-4c75-9e57-3941e6fb7dad None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.174069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a96772-2e82-4c75-9e57-3941e6fb7dad None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.174821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a96772-2e82-4c75-9e57-3941e6fb7dad None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:07.175128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a96772-2e82-4c75-9e57-3941e6fb7dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:07.176510 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a96772-2e82-4c75-9e57-3941e6fb7dad None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:07.189821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 97/188] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:07.189821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472a98a-bf63-48ea-9e8b-40c9dae1f156 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.189821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472a98a-bf63-48ea-9e8b-40c9dae1f156 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.189821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472a98a-bf63-48ea-9e8b-40c9dae1f156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.201189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacd274-dd63-477a-8240-3f61400ac999 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:07.204362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b472a98a-bf63-48ea-9e8b-40c9dae1f156 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:07.205542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b472a98a-bf63-48ea-9e8b-40c9dae1f156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:07.233281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b340f-0bd3-438e-a5e1-8c6e97554bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.233947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b340f-0bd3-438e-a5e1-8c6e97554bcb None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.234317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b340f-0bd3-438e-a5e1-8c6e97554bcb None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.234586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b340f-0bd3-438e-a5e1-8c6e97554bcb None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.235329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b340f-0bd3-438e-a5e1-8c6e97554bcb None admin] RBAC: Adding query filter params (name=reader) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:07.235627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b340f-0bd3-438e-a5e1-8c6e97554bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:07.236982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b340f-0bd3-438e-a5e1-8c6e97554bcb None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:07.245935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 92/189] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:07.246614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b340f-0bd3-438e-a5e1-8c6e97554bcb None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:07.269975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 98/190] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:07.271282 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157204bf-99e4-4746-86fa-6ba4e262500f None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.271567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157204bf-99e4-4746-86fa-6ba4e262500f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.271839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157204bf-99e4-4746-86fa-6ba4e262500f None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.273485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 99/191] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:07.274184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157204bf-99e4-4746-86fa-6ba4e262500f None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:07.353798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b340f-0bd3-438e-a5e1-8c6e97554bcb None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:07.368064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157204bf-99e4-4746-86fa-6ba4e262500f None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:07.385102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5158afa-8f43-4d1e-9ab0-71eace1e25e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.386474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158afa-8f43-4d1e-9ab0-71eace1e25e2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.386750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158afa-8f43-4d1e-9ab0-71eace1e25e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.387017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5158afa-8f43-4d1e-9ab0-71eace1e25e2 None admin] PATH_INFO: `/v3/users/f150e3f076204aebb215cf81d41185b0` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.399347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5158afa-8f43-4d1e-9ab0-71eace1e25e2 None admin] RBAC: Authorizing `identity:get_user(user_id=f150e3f076204aebb215cf81d41185b0)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:07.399770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85018c7f-502c-4d05-a592-2f294f4e1df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.401192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85018c7f-502c-4d05-a592-2f294f4e1df9 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.401468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85018c7f-502c-4d05-a592-2f294f4e1df9 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.401583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5158afa-8f43-4d1e-9ab0-71eace1e25e2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:07.401732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85018c7f-502c-4d05-a592-2f294f4e1df9 None admin] PATH_INFO: `/v3/users/067e9e150804421ea1f13ffa237d2622` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.402942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85018c7f-502c-4d05-a592-2f294f4e1df9 None admin] RBAC: Authorizing `identity:get_user(user_id=067e9e150804421ea1f13ffa237d2622)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:07.403175 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 93/192] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:07 2022] GET /identity/v3/users/f150e3f076204aebb215cf81d41185b0 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:07.404500 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85018c7f-502c-4d05-a592-2f294f4e1df9 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:07.406124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 100/193] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:07 2022] GET /identity/v3/users/067e9e150804421ea1f13ffa237d2622 => generated 289 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:07.406865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85018c7f-502c-4d05-a592-2f294f4e1df9 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:07.408984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4818785-e251-466e-b485-417d57184559 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.409271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4818785-e251-466e-b485-417d57184559 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.409540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4818785-e251-466e-b485-417d57184559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.425828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-e4818785-e251-466e-b485-417d57184559 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:07.427022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e4818785-e251-466e-b485-417d57184559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:07.489478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 94/194] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:07.490374 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4818785-e251-466e-b485-417d57184559 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:07.500747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85018c7f-502c-4d05-a592-2f294f4e1df9 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:07.534671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a99c-f39a-4c24-a52d-7b310a7fdc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.535393 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a99c-f39a-4c24-a52d-7b310a7fdc73 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.535674 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a99c-f39a-4c24-a52d-7b310a7fdc73 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.535945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a99c-f39a-4c24-a52d-7b310a7fdc73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.545702 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392a99c-f39a-4c24-a52d-7b310a7fdc73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:07.552966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-4392a99c-f39a-4c24-a52d-7b310a7fdc73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:07.554161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 101/195] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:07.554910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a99c-f39a-4c24-a52d-7b310a7fdc73 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:07.585408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4818785-e251-466e-b485-417d57184559 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:07.618233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f2e76-f997-43fc-827a-2b156276cf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.618872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f2e76-f997-43fc-827a-2b156276cf6c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.619767 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f2e76-f997-43fc-827a-2b156276cf6c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.620052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f2e76-f997-43fc-827a-2b156276cf6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.651846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392a99c-f39a-4c24-a52d-7b310a7fdc73 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:07.682837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282ec4f-2790-49dd-9baa-e6bee337343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.683468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ec4f-2790-49dd-9baa-e6bee337343d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.683574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f2e76-f997-43fc-827a-2b156276cf6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:07.683745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ec4f-2790-49dd-9baa-e6bee337343d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.684011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282ec4f-2790-49dd-9baa-e6bee337343d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.684972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f2e76-f997-43fc-827a-2b156276cf6c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:07.746783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282ec4f-2790-49dd-9baa-e6bee337343d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:07.748520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282ec4f-2790-49dd-9baa-e6bee337343d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:07.777774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 95/196] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:07.778633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f2e76-f997-43fc-827a-2b156276cf6c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:07.842389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 102/197] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:07.845207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282ec4f-2790-49dd-9baa-e6bee337343d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:07.901875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f2e76-f997-43fc-827a-2b156276cf6c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:07.934346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320cc7c-f31d-4150-bf83-016b28ea29ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.935134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320cc7c-f31d-4150-bf83-016b28ea29ea None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.935414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320cc7c-f31d-4150-bf83-016b28ea29ea None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.935685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320cc7c-f31d-4150-bf83-016b28ea29ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.936843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320cc7c-f31d-4150-bf83-016b28ea29ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:07.938297 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320cc7c-f31d-4150-bf83-016b28ea29ea None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:07.939894 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 96/198] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:07.941239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320cc7c-f31d-4150-bf83-016b28ea29ea None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:07.964380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282ec4f-2790-49dd-9baa-e6bee337343d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:07.996888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20949e4-eb55-4ea7-a340-34584b0833bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:07.997545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20949e4-eb55-4ea7-a340-34584b0833bc None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:07.997826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20949e4-eb55-4ea7-a340-34584b0833bc None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:07.998125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20949e4-eb55-4ea7-a340-34584b0833bc None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:07.998860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20949e4-eb55-4ea7-a340-34584b0833bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:07.999163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20949e4-eb55-4ea7-a340-34584b0833bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:08.000534 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20949e4-eb55-4ea7-a340-34584b0833bc None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:08.008160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 103/199] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:08.008847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20949e4-eb55-4ea7-a340-34584b0833bc None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:08.034527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320cc7c-f31d-4150-bf83-016b28ea29ea None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:08.066947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd385581-6f11-48ae-a58a-5aa2a202279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:08.067788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd385581-6f11-48ae-a58a-5aa2a202279b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:08.068062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd385581-6f11-48ae-a58a-5aa2a202279b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:08.068327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd385581-6f11-48ae-a58a-5aa2a202279b None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:08.069482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd385581-6f11-48ae-a58a-5aa2a202279b None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:08.070951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd385581-6f11-48ae-a58a-5aa2a202279b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:08.073106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 97/200] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:07 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:08.073830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd385581-6f11-48ae-a58a-5aa2a202279b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:08.102022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20949e4-eb55-4ea7-a340-34584b0833bc None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:08.133665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a4e1d-f02e-4c59-bf89-0aaef972b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:08.135363 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4e1d-f02e-4c59-bf89-0aaef972b70f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:08.135750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4e1d-f02e-4c59-bf89-0aaef972b70f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:08.136270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a4e1d-f02e-4c59-bf89-0aaef972b70f None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:08.137453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a4e1d-f02e-4c59-bf89-0aaef972b70f None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:08.138905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a4e1d-f02e-4c59-bf89-0aaef972b70f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:08.140570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 104/201] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:08 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:08.141310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a4e1d-f02e-4c59-bf89-0aaef972b70f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:08.170156 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd385581-6f11-48ae-a58a-5aa2a202279b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:08.203012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f114964-1c28-4b9f-9abe-3b2c519f7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:08.203669 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114964-1c28-4b9f-9abe-3b2c519f7de4 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:08.203945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114964-1c28-4b9f-9abe-3b2c519f7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:08.204212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f114964-1c28-4b9f-9abe-3b2c519f7de4 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:08.204908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f114964-1c28-4b9f-9abe-3b2c519f7de4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:08.206375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f114964-1c28-4b9f-9abe-3b2c519f7de4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:08.233480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a4e1d-f02e-4c59-bf89-0aaef972b70f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:08.265112 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a33661-88ab-4662-bd13-6848e526d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:08.265966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a33661-88ab-4662-bd13-6848e526d4af None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:08.266274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a33661-88ab-4662-bd13-6848e526d4af None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:08.266567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a33661-88ab-4662-bd13-6848e526d4af None admin] PATH_INFO: `/v3/users/f150e3f076204aebb215cf81d41185b0` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:08.267734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a33661-88ab-4662-bd13-6848e526d4af None admin] RBAC: Authorizing `identity:get_user(user_id=f150e3f076204aebb215cf81d41185b0)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:08.269141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a33661-88ab-4662-bd13-6848e526d4af None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:08.270777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 105/202] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:08 2022] GET /identity/v3/users/f150e3f076204aebb215cf81d41185b0 => generated 283 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:08.271522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a33661-88ab-4662-bd13-6848e526d4af None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:08.289982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 98/203] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:35:08 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:35:08.291355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f114964-1c28-4b9f-9abe-3b2c519f7de4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:08.374491 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a33661-88ab-4662-bd13-6848e526d4af None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:08.395286 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f114964-1c28-4b9f-9abe-3b2c519f7de4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:08.409946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97351a50-3dd6-4808-9c05-1bf09ce4257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:08.411012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351a50-3dd6-4808-9c05-1bf09ce4257c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:08.411365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351a50-3dd6-4808-9c05-1bf09ce4257c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:08.411713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351a50-3dd6-4808-9c05-1bf09ce4257c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:08.412640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97351a50-3dd6-4808-9c05-1bf09ce4257c None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=aae7a29125d84943bd6b641569d01895, user.id=f150e3f076204aebb215cf81d41185b0) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:08.413016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97351a50-3dd6-4808-9c05-1bf09ce4257c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:08.414619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97351a50-3dd6-4808-9c05-1bf09ce4257c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:08.420821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 106/204] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:08 2022] GET /identity/v3/role_assignments?user.id=f150e3f076204aebb215cf81d41185b0&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:08.422971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97351a50-3dd6-4808-9c05-1bf09ce4257c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:08.431279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bad36-966e-4d89-a77e-5774f33e0942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:08.432493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bad36-966e-4d89-a77e-5774f33e0942 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:08.432914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bad36-966e-4d89-a77e-5774f33e0942 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:08.433204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bad36-966e-4d89-a77e-5774f33e0942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:08.434132 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bad36-966e-4d89-a77e-5774f33e0942 None admin] RBAC: Adding query filter params (role.id=2151a047bd9744e5be942a6bbd8c0f28, scope.project.id=7b3f655528294e62a0a33ce69e504013, user.id=067e9e150804421ea1f13ffa237d2622) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:08.434446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bad36-966e-4d89-a77e-5774f33e0942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:08.436036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bad36-966e-4d89-a77e-5774f33e0942 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:08.442808 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 99/205] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:08 2022] GET /identity/v3/role_assignments?user.id=067e9e150804421ea1f13ffa237d2622&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=2151a047bd9744e5be942a6bbd8c0f28 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:08.546760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97351a50-3dd6-4808-9c05-1bf09ce4257c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:08.586272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060314db-8f67-4d34-ba3d-28dbb29c5597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:08.587212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060314db-8f67-4d34-ba3d-28dbb29c5597 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:08.588175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060314db-8f67-4d34-ba3d-28dbb29c5597 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:08.588849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060314db-8f67-4d34-ba3d-28dbb29c5597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:08.666849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060314db-8f67-4d34-ba3d-28dbb29c5597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:08.668252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060314db-8f67-4d34-ba3d-28dbb29c5597 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:08.770996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 107/206] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:08.777095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bad36-966e-4d89-a77e-5774f33e0942 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:08.882638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bad36-966e-4d89-a77e-5774f33e0942 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:08.917793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42c7c4-3712-46cf-9e5a-899870434c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:08.918615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c7c4-3712-46cf-9e5a-899870434c2c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:08.918895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c7c4-3712-46cf-9e5a-899870434c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:08.919166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42c7c4-3712-46cf-9e5a-899870434c2c None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:08.920365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42c7c4-3712-46cf-9e5a-899870434c2c None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:08.921809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42c7c4-3712-46cf-9e5a-899870434c2c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:08.923525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 100/207] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:08 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:08.929454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060314db-8f67-4d34-ba3d-28dbb29c5597 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:09.029527 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060314db-8f67-4d34-ba3d-28dbb29c5597 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:09.065074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260af87-d45f-4a42-9ed1-0f48dad4d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:09.065730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260af87-d45f-4a42-9ed1-0f48dad4d933 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:09.066025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260af87-d45f-4a42-9ed1-0f48dad4d933 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:09.066302 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260af87-d45f-4a42-9ed1-0f48dad4d933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:09.067131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260af87-d45f-4a42-9ed1-0f48dad4d933 None admin] RBAC: Adding query filter params (role.id=e83d49af62db4f4aa2dcadb10a82bfdc, scope.project.id=aae7a29125d84943bd6b641569d01895, user.id=f150e3f076204aebb215cf81d41185b0) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:09.067439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260af87-d45f-4a42-9ed1-0f48dad4d933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:09.068881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260af87-d45f-4a42-9ed1-0f48dad4d933 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:09.075031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 108/208] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:08 2022] GET /identity/v3/role_assignments?user.id=f150e3f076204aebb215cf81d41185b0&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=e83d49af62db4f4aa2dcadb10a82bfdc => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:10.915479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd212f-2021-4bfa-97a2-978c123fa33c None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:10.916161 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd212f-2021-4bfa-97a2-978c123fa33c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:10.916249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd212f-2021-4bfa-97a2-978c123fa33c None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:10.918029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 101/209] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:10.936348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f239f7-3b02-4ec5-9da6-99493409ffba None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:10.936348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f239f7-3b02-4ec5-9da6-99493409ffba None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:10.936348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f239f7-3b02-4ec5-9da6-99493409ffba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:10.953901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-04f239f7-3b02-4ec5-9da6-99493409ffba None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:10.955493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-04f239f7-3b02-4ec5-9da6-99493409ffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:10.975948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e09282-4621-4510-af96-c8f5bb8006a8 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:10.976569 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e09282-4621-4510-af96-c8f5bb8006a8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:10.977039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e09282-4621-4510-af96-c8f5bb8006a8 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:10.983414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 102/210] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:10.985214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116f76-5ce5-40d0-97db-3ff421524921 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:10.985716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116f76-5ce5-40d0-97db-3ff421524921 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:10.986208 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc116f76-5ce5-40d0-97db-3ff421524921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.005068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-bc116f76-5ce5-40d0-97db-3ff421524921 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:11.006796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-bc116f76-5ce5-40d0-97db-3ff421524921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:11.032824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 109/211] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:11.032824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bcc04-7fba-4708-a9fc-de7a24ac7dd9 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.032824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bcc04-7fba-4708-a9fc-de7a24ac7dd9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.032824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bcc04-7fba-4708-a9fc-de7a24ac7dd9 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.032824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 110/212] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:11.037916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c1695-aeef-4127-b241-7826b97748ab None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.038233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c1695-aeef-4127-b241-7826b97748ab None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.038506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c1695-aeef-4127-b241-7826b97748ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.055627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-f56c1695-aeef-4127-b241-7826b97748ab None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:11.057159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f56c1695-aeef-4127-b241-7826b97748ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:11.078151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 103/213] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:11.078317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc116f76-5ce5-40d0-97db-3ff421524921 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:11.126043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 111/214] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:11.127294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c1695-aeef-4127-b241-7826b97748ab None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:11.187101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc116f76-5ce5-40d0-97db-3ff421524921 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:11.220163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1efef-a9e9-4814-9519-1c39ec2baff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:11.220961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1efef-a9e9-4814-9519-1c39ec2baff7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.221244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1efef-a9e9-4814-9519-1c39ec2baff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.221515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1efef-a9e9-4814-9519-1c39ec2baff7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.224284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c1695-aeef-4127-b241-7826b97748ab None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:11.232665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1efef-a9e9-4814-9519-1c39ec2baff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:11.239689 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-1dc1efef-a9e9-4814-9519-1c39ec2baff7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:11.246380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 104/215] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:11.246380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1efef-a9e9-4814-9519-1c39ec2baff7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:11.263770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cda31-f927-49d8-950b-6b693d0a1ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:11.264560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cda31-f927-49d8-950b-6b693d0a1ba3 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.264836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cda31-f927-49d8-950b-6b693d0a1ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.265103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cda31-f927-49d8-950b-6b693d0a1ba3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.274885 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cda31-f927-49d8-950b-6b693d0a1ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:11.282101 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-af0cda31-f927-49d8-950b-6b693d0a1ba3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:35:11.288161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 112/216] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:11.288161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cda31-f927-49d8-950b-6b693d0a1ba3 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:11.344213 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1efef-a9e9-4814-9519-1c39ec2baff7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:11.378153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e079-e500-4a5b-af59-172472a62b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:11.378870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e079-e500-4a5b-af59-172472a62b82 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.379149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e079-e500-4a5b-af59-172472a62b82 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.379424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e079-e500-4a5b-af59-172472a62b82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.380590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e079-e500-4a5b-af59-172472a62b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:11.382062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e079-e500-4a5b-af59-172472a62b82 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:11.383125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cda31-f927-49d8-950b-6b693d0a1ba3 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:11.383886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 105/217] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:11.387033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e079-e500-4a5b-af59-172472a62b82 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:11.422028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf8a7c-dd50-4cd6-ad18-7a77410afe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:11.422685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf8a7c-dd50-4cd6-ad18-7a77410afe52 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.422961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf8a7c-dd50-4cd6-ad18-7a77410afe52 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.423226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf8a7c-dd50-4cd6-ad18-7a77410afe52 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.423971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf8a7c-dd50-4cd6-ad18-7a77410afe52 None admin] RBAC: Adding query filter params (name=member) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:11.424272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf8a7c-dd50-4cd6-ad18-7a77410afe52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:11.425636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf8a7c-dd50-4cd6-ad18-7a77410afe52 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:11.434044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 113/218] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:11.434766 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf8a7c-dd50-4cd6-ad18-7a77410afe52 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:11.490464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e079-e500-4a5b-af59-172472a62b82 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:11.523242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b43c42-7658-4d35-b861-7322592a588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:11.523909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b43c42-7658-4d35-b861-7322592a588d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.524180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b43c42-7658-4d35-b861-7322592a588d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.524449 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b43c42-7658-4d35-b861-7322592a588d None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.525729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b43c42-7658-4d35-b861-7322592a588d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:11.526047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b43c42-7658-4d35-b861-7322592a588d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:11.527430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b43c42-7658-4d35-b861-7322592a588d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:11.535183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 106/219] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:11.535957 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b43c42-7658-4d35-b861-7322592a588d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:11.539518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf8a7c-dd50-4cd6-ad18-7a77410afe52 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:11.571392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e5212-11ab-44f1-86a1-35e9934f379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:11.572277 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e5212-11ab-44f1-86a1-35e9934f379d None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.572573 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e5212-11ab-44f1-86a1-35e9934f379d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.572853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e5212-11ab-44f1-86a1-35e9934f379d None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.573553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e5212-11ab-44f1-86a1-35e9934f379d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:11.575029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e5212-11ab-44f1-86a1-35e9934f379d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:11.628938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b43c42-7658-4d35-b861-7322592a588d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:11.660927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed153c-9d37-4cbb-97e2-81b45efbe613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:11.661907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed153c-9d37-4cbb-97e2-81b45efbe613 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.662236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed153c-9d37-4cbb-97e2-81b45efbe613 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.662537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed153c-9d37-4cbb-97e2-81b45efbe613 None admin] PATH_INFO: `/v3/users/92a7d09c47354a7898261a6ad910cfbd` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.676243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed153c-9d37-4cbb-97e2-81b45efbe613 None admin] RBAC: Authorizing `identity:get_user(user_id=92a7d09c47354a7898261a6ad910cfbd)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:11.677728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed153c-9d37-4cbb-97e2-81b45efbe613 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:11.679471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 107/220] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:11 2022] GET /identity/v3/users/92a7d09c47354a7898261a6ad910cfbd => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:11.680658 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80660-51f3-4abd-a6fd-2a9aa833feb1 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.680937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80660-51f3-4abd-a6fd-2a9aa833feb1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.681262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e80660-51f3-4abd-a6fd-2a9aa833feb1 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.683147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 108/221] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:11.684594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80660-51f3-4abd-a6fd-2a9aa833feb1 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:11.697501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 114/222] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:35:11 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:35:11.698346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e5212-11ab-44f1-86a1-35e9934f379d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:11.791728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e80660-51f3-4abd-a6fd-2a9aa833feb1 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:11.814478 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e5212-11ab-44f1-86a1-35e9934f379d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:11.832112 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b598b5-ce98-4f64-889f-4f643c384d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:11.833012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b598b5-ce98-4f64-889f-4f643c384d5d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.833313 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b598b5-ce98-4f64-889f-4f643c384d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.833651 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b598b5-ce98-4f64-889f-4f643c384d5d None admin] PATH_INFO: `/v3/users/f150e3f076204aebb215cf81d41185b0` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.834896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b598b5-ce98-4f64-889f-4f643c384d5d None admin] RBAC: Authorizing `identity:get_user(user_id=f150e3f076204aebb215cf81d41185b0)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:11.836392 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b598b5-ce98-4f64-889f-4f643c384d5d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:11.844436 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 109/223] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:11 2022] GET /identity/v3/users/f150e3f076204aebb215cf81d41185b0 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:11.844436 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9459b7c-5e38-4ebe-932f-41707b37e2d3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.844436 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9459b7c-5e38-4ebe-932f-41707b37e2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.844436 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9459b7c-5e38-4ebe-932f-41707b37e2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.861857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34719f6-5879-434c-9dff-5a5428ac8f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:11.862329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-b9459b7c-5e38-4ebe-932f-41707b37e2d3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:11.862650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34719f6-5879-434c-9dff-5a5428ac8f97 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:11.862934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34719f6-5879-434c-9dff-5a5428ac8f97 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:11.863280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34719f6-5879-434c-9dff-5a5428ac8f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:11.863561 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b9459b7c-5e38-4ebe-932f-41707b37e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:11.935743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34719f6-5879-434c-9dff-5a5428ac8f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:11.936808 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 110/224] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:11.937299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34719f6-5879-434c-9dff-5a5428ac8f97 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:11.938652 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9459b7c-5e38-4ebe-932f-41707b37e2d3 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:12.042222 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9459b7c-5e38-4ebe-932f-41707b37e2d3 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:12.044446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 115/225] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:12.045577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34719f6-5879-434c-9dff-5a5428ac8f97 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:12.082533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e51b42-aaeb-4786-97e8-94b983cedcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:12.083773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e51b42-aaeb-4786-97e8-94b983cedcaf None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:12.084243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e51b42-aaeb-4786-97e8-94b983cedcaf None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:12.084732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e51b42-aaeb-4786-97e8-94b983cedcaf None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:12.085941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e51b42-aaeb-4786-97e8-94b983cedcaf None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:12.087429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e51b42-aaeb-4786-97e8-94b983cedcaf None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:12.089439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 111/226] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:11 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:12.090056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e51b42-aaeb-4786-97e8-94b983cedcaf None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:12.154661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34719f6-5879-434c-9dff-5a5428ac8f97 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:12.189522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb941f-4cbb-41f7-ba40-fd72576faa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:12.190272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb941f-4cbb-41f7-ba40-fd72576faa94 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:12.190553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb941f-4cbb-41f7-ba40-fd72576faa94 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:12.190825 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb941f-4cbb-41f7-ba40-fd72576faa94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:12.193948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e51b42-aaeb-4786-97e8-94b983cedcaf None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:12.201826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb941f-4cbb-41f7-ba40-fd72576faa94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:12.209395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-54bb941f-4cbb-41f7-ba40-fd72576faa94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:12.210995 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 116/227] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:12.211768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb941f-4cbb-41f7-ba40-fd72576faa94 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:12.230903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7183e2-72aa-4de4-90d5-605d87dd2efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:12.232038 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7183e2-72aa-4de4-90d5-605d87dd2efd None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:12.232321 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7183e2-72aa-4de4-90d5-605d87dd2efd None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:12.232890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7183e2-72aa-4de4-90d5-605d87dd2efd None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:12.234115 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7183e2-72aa-4de4-90d5-605d87dd2efd None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:12.236012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7183e2-72aa-4de4-90d5-605d87dd2efd None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:12.238341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 112/228] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:12 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:12.239317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7183e2-72aa-4de4-90d5-605d87dd2efd None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:12.315752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb941f-4cbb-41f7-ba40-fd72576faa94 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:12.351666 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29ae81-f316-42d5-b994-e15f146ddfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:12.352636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29ae81-f316-42d5-b994-e15f146ddfd0 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:12.352846 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7183e2-72aa-4de4-90d5-605d87dd2efd None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:12.352970 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29ae81-f316-42d5-b994-e15f146ddfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:12.353343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29ae81-f316-42d5-b994-e15f146ddfd0 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895/users/f150e3f076204aebb215cf81d41185b0/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:12.355420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29ae81-f316-42d5-b994-e15f146ddfd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=aae7a29125d84943bd6b641569d01895, user_id=f150e3f076204aebb215cf81d41185b0, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:12.356880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29ae81-f316-42d5-b994-e15f146ddfd0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:12.387020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715c09-cf12-4f00-9d5a-3bee1a7efc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:12.387679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715c09-cf12-4f00-9d5a-3bee1a7efc68 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:12.387954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715c09-cf12-4f00-9d5a-3bee1a7efc68 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:12.388221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715c09-cf12-4f00-9d5a-3bee1a7efc68 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:12.388968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715c09-cf12-4f00-9d5a-3bee1a7efc68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:12.389263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715c09-cf12-4f00-9d5a-3bee1a7efc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:12.390653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715c09-cf12-4f00-9d5a-3bee1a7efc68 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:12.398506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 113/229] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:12.399146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715c09-cf12-4f00-9d5a-3bee1a7efc68 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:12.474901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 117/230] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:35:12 2022] PUT /identity/v3/projects/aae7a29125d84943bd6b641569d01895/users/f150e3f076204aebb215cf81d41185b0/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:12.476041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29ae81-f316-42d5-b994-e15f146ddfd0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:12.496493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715c09-cf12-4f00-9d5a-3bee1a7efc68 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:12.534816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd15de8-7c8d-43b1-bc1b-425a9f7cce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:12.535474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd15de8-7c8d-43b1-bc1b-425a9f7cce14 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:12.535749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd15de8-7c8d-43b1-bc1b-425a9f7cce14 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:12.536018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd15de8-7c8d-43b1-bc1b-425a9f7cce14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:12.536843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd15de8-7c8d-43b1-bc1b-425a9f7cce14 None admin] RBAC: Adding query filter params (role.id=b15932e4d63b437eb478fd41d0ae6ec6, scope.project.id=aae7a29125d84943bd6b641569d01895, user.id=92a7d09c47354a7898261a6ad910cfbd) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:12.537149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd15de8-7c8d-43b1-bc1b-425a9f7cce14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:12.538768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd15de8-7c8d-43b1-bc1b-425a9f7cce14 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:12.544892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 114/231] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:12 2022] GET /identity/v3/role_assignments?user.id=92a7d09c47354a7898261a6ad910cfbd&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:12.593827 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29ae81-f316-42d5-b994-e15f146ddfd0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:12.632729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b07b8-3aad-439a-aa6a-675fccb75482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:12.633951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b07b8-3aad-439a-aa6a-675fccb75482 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:12.635457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b07b8-3aad-439a-aa6a-675fccb75482 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:12.636176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b07b8-3aad-439a-aa6a-675fccb75482 None admin] PATH_INFO: `/v3/users/f150e3f076204aebb215cf81d41185b0` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:12.637754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b07b8-3aad-439a-aa6a-675fccb75482 None admin] RBAC: Authorizing `identity:get_user(user_id=f150e3f076204aebb215cf81d41185b0)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:12.639537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b07b8-3aad-439a-aa6a-675fccb75482 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:12.641495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 118/232] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:12 2022] GET /identity/v3/users/f150e3f076204aebb215cf81d41185b0 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:12.647354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd15de8-7c8d-43b1-bc1b-425a9f7cce14 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:12.787656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd15de8-7c8d-43b1-bc1b-425a9f7cce14 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:12.821372 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf7bf1-c5c0-4574-86e3-219ab66505f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:12.822930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7bf1-c5c0-4574-86e3-219ab66505f4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:12.823358 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7bf1-c5c0-4574-86e3-219ab66505f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:12.823637 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf7bf1-c5c0-4574-86e3-219ab66505f4 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:12.824832 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf7bf1-c5c0-4574-86e3-219ab66505f4 None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:12.826294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf7bf1-c5c0-4574-86e3-219ab66505f4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:12.828284 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 115/233] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:12 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:12.833753 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b07b8-3aad-439a-aa6a-675fccb75482 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:12.990980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b07b8-3aad-439a-aa6a-675fccb75482 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:13.033498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3892f-1f46-414b-b8f8-77073cfa7009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:13.034769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3892f-1f46-414b-b8f8-77073cfa7009 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:13.035250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3892f-1f46-414b-b8f8-77073cfa7009 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:13.035717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3892f-1f46-414b-b8f8-77073cfa7009 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895/users/f150e3f076204aebb215cf81d41185b0/roles/e83d49af62db4f4aa2dcadb10a82bfdc` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:13.038238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3892f-1f46-414b-b8f8-77073cfa7009 None admin] RBAC: Authorizing `identity:create_grant(project_id=aae7a29125d84943bd6b641569d01895, user_id=f150e3f076204aebb215cf81d41185b0, role_id=e83d49af62db4f4aa2dcadb10a82bfdc)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:13.039900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3892f-1f46-414b-b8f8-77073cfa7009 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:13.149655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 119/234] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:35:12 2022] PUT /identity/v3/projects/aae7a29125d84943bd6b641569d01895/users/f150e3f076204aebb215cf81d41185b0/roles/e83d49af62db4f4aa2dcadb10a82bfdc => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:14.536670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c7bbd-7347-456d-bc8d-0718ebb75b5b None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:14.537211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c7bbd-7347-456d-bc8d-0718ebb75b5b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:14.537211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c7bbd-7347-456d-bc8d-0718ebb75b5b None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:14.539132 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 116/235] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:14.555715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6be55-d512-4da9-a7e4-be3489503ba4 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:14.556770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6be55-d512-4da9-a7e4-be3489503ba4 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:14.556770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6be55-d512-4da9-a7e4-be3489503ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:14.573821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-10e6be55-d512-4da9-a7e4-be3489503ba4 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:14.575055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-10e6be55-d512-4da9-a7e4-be3489503ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:14.642571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 120/236] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:14.677705 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c7bbd-7347-456d-bc8d-0718ebb75b5b None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:14.786507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cf3c9-676c-437d-8861-a3653d311b29 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:14.786951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cf3c9-676c-437d-8861-a3653d311b29 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:14.787275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cf3c9-676c-437d-8861-a3653d311b29 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:14.787782 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c7bbd-7347-456d-bc8d-0718ebb75b5b None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:14.789210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 121/237] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:14.795329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4589bb-5524-4175-af9d-1dc5e50c8241 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:14.795609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4589bb-5524-4175-af9d-1dc5e50c8241 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:14.795880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4589bb-5524-4175-af9d-1dc5e50c8241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:14.823102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1ea05-cbf1-4c91-8ab7-7f05789015e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:14.827809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1ea05-cbf1-4c91-8ab7-7f05789015e3 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:14.827809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1ea05-cbf1-4c91-8ab7-7f05789015e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:14.827809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1ea05-cbf1-4c91-8ab7-7f05789015e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:14.830835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1ea05-cbf1-4c91-8ab7-7f05789015e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:14.832316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1ea05-cbf1-4c91-8ab7-7f05789015e3 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:14.834126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 117/238] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:14.839489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0c4589bb-5524-4175-af9d-1dc5e50c8241 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:14.840744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0c4589bb-5524-4175-af9d-1dc5e50c8241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:14.857106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1ea05-cbf1-4c91-8ab7-7f05789015e3 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:14.963227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1ea05-cbf1-4c91-8ab7-7f05789015e3 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:14.968483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 122/239] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:14.997691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283c84-c038-487b-b0dc-5a8699a283e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:14.998387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283c84-c038-487b-b0dc-5a8699a283e7 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:14.998665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283c84-c038-487b-b0dc-5a8699a283e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:14.999098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283c84-c038-487b-b0dc-5a8699a283e7 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:14.999803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce283c84-c038-487b-b0dc-5a8699a283e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:15.001427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce283c84-c038-487b-b0dc-5a8699a283e7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:15.011526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4589bb-5524-4175-af9d-1dc5e50c8241 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:15.096691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 118/240] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:35:14 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:35:15.140429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4589bb-5524-4175-af9d-1dc5e50c8241 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:15.179844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6933b7-d58e-4ac9-a8fc-ce54af62d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:15.180670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6933b7-d58e-4ac9-a8fc-ce54af62d12c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:15.180952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6933b7-d58e-4ac9-a8fc-ce54af62d12c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:15.181285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6933b7-d58e-4ac9-a8fc-ce54af62d12c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:15.192873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6933b7-d58e-4ac9-a8fc-ce54af62d12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:15.200108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-4a6933b7-d58e-4ac9-a8fc-ce54af62d12c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 21:35:15.201675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 123/241] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:15.207586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283c84-c038-487b-b0dc-5a8699a283e7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:15.335272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283c84-c038-487b-b0dc-5a8699a283e7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:15.371630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff9832-e262-4892-b36e-8cab0f665969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:15.372231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9832-e262-4892-b36e-8cab0f665969 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:15.372512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9832-e262-4892-b36e-8cab0f665969 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:15.372786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff9832-e262-4892-b36e-8cab0f665969 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:15.373540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff9832-e262-4892-b36e-8cab0f665969 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:15.373842 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff9832-e262-4892-b36e-8cab0f665969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:15.375255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff9832-e262-4892-b36e-8cab0f665969 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:15.385326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 119/242] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:15.386685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287a0b-bfc5-4d8a-b226-e28ee93c1862 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:15.386973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287a0b-bfc5-4d8a-b226-e28ee93c1862 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:15.387250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287a0b-bfc5-4d8a-b226-e28ee93c1862 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:15.389345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 124/243] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:15.393784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff9832-e262-4892-b36e-8cab0f665969 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:15.398181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c3f7-5d2a-4ed5-a613-c38dff2a3014 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:15.398652 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c3f7-5d2a-4ed5-a613-c38dff2a3014 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:15.398933 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251c3f7-5d2a-4ed5-a613-c38dff2a3014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:15.425003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4251c3f7-5d2a-4ed5-a613-c38dff2a3014 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:15.426223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4251c3f7-5d2a-4ed5-a613-c38dff2a3014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:15.511895 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 125/244] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:15.522765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff9832-e262-4892-b36e-8cab0f665969 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:15.536664 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251c3f7-5d2a-4ed5-a613-c38dff2a3014 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:15.565184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f4b85-5c8c-46bc-a83a-4d44f8cc1190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:15.566129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f4b85-5c8c-46bc-a83a-4d44f8cc1190 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:15.566390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f4b85-5c8c-46bc-a83a-4d44f8cc1190 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:15.566675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f4b85-5c8c-46bc-a83a-4d44f8cc1190 None admin] PATH_INFO: `/v3/users/6b14099900ad45f5913d64886cef55c2` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:15.581853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f4b85-5c8c-46bc-a83a-4d44f8cc1190 None admin] RBAC: Authorizing `identity:get_user(user_id=6b14099900ad45f5913d64886cef55c2)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:15.583560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f4b85-5c8c-46bc-a83a-4d44f8cc1190 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:15.585726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 120/245] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:15 2022] GET /identity/v3/users/6b14099900ad45f5913d64886cef55c2 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:15.591254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f4b85-5c8c-46bc-a83a-4d44f8cc1190 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:15.669038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251c3f7-5d2a-4ed5-a613-c38dff2a3014 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:15.701874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f4b85-5c8c-46bc-a83a-4d44f8cc1190 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:15.709055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b55b4e-2636-44dc-947d-723ac077e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:15.710200 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b55b4e-2636-44dc-947d-723ac077e55b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:15.710684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b55b4e-2636-44dc-947d-723ac077e55b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:15.711174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b55b4e-2636-44dc-947d-723ac077e55b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:15.722502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b55b4e-2636-44dc-947d-723ac077e55b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:15.730473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-c7b55b4e-2636-44dc-947d-723ac077e55b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:15.732231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 126/246] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:15.733655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f6a7f-543d-46d4-96a0-1cdec8080882 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:15.734293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f6a7f-543d-46d4-96a0-1cdec8080882 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:15.734830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f6a7f-543d-46d4-96a0-1cdec8080882 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:15.737006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 127/247] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:15.741582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3baadd-a04d-4d13-b33c-b979432bfef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:15.742391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3baadd-a04d-4d13-b33c-b979432bfef6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:15.742670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3baadd-a04d-4d13-b33c-b979432bfef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:15.742941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3baadd-a04d-4d13-b33c-b979432bfef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:15.744032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201f94-d713-42b9-a5ec-96798c5aaaee None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:15.744671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201f94-d713-42b9-a5ec-96798c5aaaee None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:15.745146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47201f94-d713-42b9-a5ec-96798c5aaaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:15.764334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-47201f94-d713-42b9-a5ec-96798c5aaaee None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:15.765864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-47201f94-d713-42b9-a5ec-96798c5aaaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:15.823464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3baadd-a04d-4d13-b33c-b979432bfef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:15.824951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3baadd-a04d-4d13-b33c-b979432bfef6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:15.855804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 128/248] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:15.857055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47201f94-d713-42b9-a5ec-96798c5aaaee None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:16.015587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 121/249] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:16.016696 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3baadd-a04d-4d13-b33c-b979432bfef6 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:16.045924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47201f94-d713-42b9-a5ec-96798c5aaaee None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:16.085456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bc3c9-501c-4363-a868-c4ec20a83f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:16.086441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bc3c9-501c-4363-a868-c4ec20a83f68 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.086923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bc3c9-501c-4363-a868-c4ec20a83f68 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.087943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bc3c9-501c-4363-a868-c4ec20a83f68 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.088889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bc3c9-501c-4363-a868-c4ec20a83f68 None admin] RBAC: Adding query filter params (name=member) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:16.089386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bc3c9-501c-4363-a868-c4ec20a83f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:16.090997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bc3c9-501c-4363-a868-c4ec20a83f68 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:16.099365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 129/250] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:16.100847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35901b-3d78-4054-8670-e84a0795b0ca None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.101405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35901b-3d78-4054-8670-e84a0795b0ca None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.101872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35901b-3d78-4054-8670-e84a0795b0ca None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.104048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 130/251] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:16.105322 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35901b-3d78-4054-8670-e84a0795b0ca None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:16.124556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3baadd-a04d-4d13-b33c-b979432bfef6 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:16.159371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad69037-91bf-4625-81d2-3f226efde0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:16.160196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad69037-91bf-4625-81d2-3f226efde0e3 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.160483 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad69037-91bf-4625-81d2-3f226efde0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.160758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad69037-91bf-4625-81d2-3f226efde0e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.171170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad69037-91bf-4625-81d2-3f226efde0e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:16.178810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-0ad69037-91bf-4625-81d2-3f226efde0e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:35:16.180531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 122/252] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:35:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:16.182996 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad69037-91bf-4625-81d2-3f226efde0e3 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:16.225133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35901b-3d78-4054-8670-e84a0795b0ca None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:16.272204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900183d-b40e-4ffb-b402-fb7bbde54389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:16.273829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900183d-b40e-4ffb-b402-fb7bbde54389 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.274667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900183d-b40e-4ffb-b402-fb7bbde54389 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.275821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900183d-b40e-4ffb-b402-fb7bbde54389 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.277465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900183d-b40e-4ffb-b402-fb7bbde54389 None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:16.279426 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900183d-b40e-4ffb-b402-fb7bbde54389 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:16.282034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 131/253] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:16 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:16.283334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de704-d4fb-4254-bb03-973f886f0d63 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.284840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de704-d4fb-4254-bb03-973f886f0d63 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.285125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340de704-d4fb-4254-bb03-973f886f0d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.302831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-340de704-d4fb-4254-bb03-973f886f0d63 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:16.304017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-340de704-d4fb-4254-bb03-973f886f0d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:16.304269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad69037-91bf-4625-81d2-3f226efde0e3 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:16.346588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f3f9-00d9-4b02-ab37-b7cfff44d645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:16.348393 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f3f9-00d9-4b02-ab37-b7cfff44d645 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.348880 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f3f9-00d9-4b02-ab37-b7cfff44d645 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.349364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f3f9-00d9-4b02-ab37-b7cfff44d645 None admin] PATH_INFO: `/v3/users/92a7d09c47354a7898261a6ad910cfbd` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.351204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f3f9-00d9-4b02-ab37-b7cfff44d645 None admin] RBAC: Authorizing `identity:get_user(user_id=92a7d09c47354a7898261a6ad910cfbd)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:16.354300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f3f9-00d9-4b02-ab37-b7cfff44d645 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:16.356990 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 123/254] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:16 2022] GET /identity/v3/users/92a7d09c47354a7898261a6ad910cfbd => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:16.361704 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f3f9-00d9-4b02-ab37-b7cfff44d645 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:16.388036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 132/255] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:16.388944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340de704-d4fb-4254-bb03-973f886f0d63 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:16.487480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340de704-d4fb-4254-bb03-973f886f0d63 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:16.489762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f3f9-00d9-4b02-ab37-b7cfff44d645 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:16.522373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f73e2-0ba5-44f1-b9db-0cfe64fd4d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:16.523533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f73e2-0ba5-44f1-b9db-0cfe64fd4d53 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.524025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f73e2-0ba5-44f1-b9db-0cfe64fd4d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.524544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f73e2-0ba5-44f1-b9db-0cfe64fd4d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.525908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f73e2-0ba5-44f1-b9db-0cfe64fd4d53 None admin] RBAC: Adding query filter params (role.id=2151a047bd9744e5be942a6bbd8c0f28, scope.project.id=aae7a29125d84943bd6b641569d01895, user.id=6b14099900ad45f5913d64886cef55c2) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:16.526518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f73e2-0ba5-44f1-b9db-0cfe64fd4d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:16.528770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f73e2-0ba5-44f1-b9db-0cfe64fd4d53 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:16.530336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436ed8-d460-4519-896d-2898606054b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:16.531026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436ed8-d460-4519-896d-2898606054b7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.531305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436ed8-d460-4519-896d-2898606054b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.531581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436ed8-d460-4519-896d-2898606054b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.532586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07436ed8-d460-4519-896d-2898606054b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:16.532893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07436ed8-d460-4519-896d-2898606054b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:16.535164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07436ed8-d460-4519-896d-2898606054b7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:16.537187 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 133/256] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:16 2022] GET /identity/v3/role_assignments?user.id=6b14099900ad45f5913d64886cef55c2&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=2151a047bd9744e5be942a6bbd8c0f28 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:16.538397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f73e2-0ba5-44f1-b9db-0cfe64fd4d53 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:16.546361 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 124/257] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:16.551639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436ed8-d460-4519-896d-2898606054b7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:16.656750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f73e2-0ba5-44f1-b9db-0cfe64fd4d53 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:16.677888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436ed8-d460-4519-896d-2898606054b7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:16.694916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807a01-4d05-48eb-be63-eb7f87cdd8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:16.699893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807a01-4d05-48eb-be63-eb7f87cdd8a7 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.701962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807a01-4d05-48eb-be63-eb7f87cdd8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.702523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807a01-4d05-48eb-be63-eb7f87cdd8a7 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.704173 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7807a01-4d05-48eb-be63-eb7f87cdd8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:16.705910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7807a01-4d05-48eb-be63-eb7f87cdd8a7 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:16.708388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 134/258] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:16 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:16.714063 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807a01-4d05-48eb-be63-eb7f87cdd8a7 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:16.726708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e52307-f07f-4d6d-8b6d-74fc66dc8753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:16.727547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e52307-f07f-4d6d-8b6d-74fc66dc8753 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.727856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e52307-f07f-4d6d-8b6d-74fc66dc8753 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.728214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e52307-f07f-4d6d-8b6d-74fc66dc8753 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.755109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e52307-f07f-4d6d-8b6d-74fc66dc8753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:16.766506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-23e52307-f07f-4d6d-8b6d-74fc66dc8753 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:16.767974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 125/259] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:16.768546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e52307-f07f-4d6d-8b6d-74fc66dc8753 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:16.904671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e52307-f07f-4d6d-8b6d-74fc66dc8753 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:16.915711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807a01-4d05-48eb-be63-eb7f87cdd8a7 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:16.950714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c5ad0-6cb2-4b0f-ade3-c33d4eaf72a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:16.951629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c5ad0-6cb2-4b0f-ade3-c33d4eaf72a5 None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.951912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c5ad0-6cb2-4b0f-ade3-c33d4eaf72a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.952189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c5ad0-6cb2-4b0f-ade3-c33d4eaf72a5 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895/users/92a7d09c47354a7898261a6ad910cfbd/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.954329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c5ad0-6cb2-4b0f-ade3-c33d4eaf72a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=aae7a29125d84943bd6b641569d01895, user_id=92a7d09c47354a7898261a6ad910cfbd, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:16.955789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c5ad0-6cb2-4b0f-ade3-c33d4eaf72a5 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:16.963178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b87a6a-d5d1-40a8-8d11-d520d9c9ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:16.964059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b87a6a-d5d1-40a8-8d11-d520d9c9ed23 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:16.964341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b87a6a-d5d1-40a8-8d11-d520d9c9ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:16.964612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b87a6a-d5d1-40a8-8d11-d520d9c9ed23 None admin] PATH_INFO: `/v3/users/f150e3f076204aebb215cf81d41185b0` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:16.965837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b87a6a-d5d1-40a8-8d11-d520d9c9ed23 None admin] RBAC: Authorizing `identity:get_user(user_id=f150e3f076204aebb215cf81d41185b0)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:16.967373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b87a6a-d5d1-40a8-8d11-d520d9c9ed23 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:16.969012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 135/260] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:16 2022] GET /identity/v3/users/f150e3f076204aebb215cf81d41185b0 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:16.969859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b87a6a-d5d1-40a8-8d11-d520d9c9ed23 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:17.023098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 126/261] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:35:16 2022] PUT /identity/v3/projects/aae7a29125d84943bd6b641569d01895/users/92a7d09c47354a7898261a6ad910cfbd/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:17.024200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c5ad0-6cb2-4b0f-ade3-c33d4eaf72a5 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:17.149525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b87a6a-d5d1-40a8-8d11-d520d9c9ed23 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:17.205597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c5ad0-6cb2-4b0f-ade3-c33d4eaf72a5 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:17.234722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807db47f-868a-4b6c-b7f1-1448079b2cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:17.235410 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db47f-868a-4b6c-b7f1-1448079b2cd2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:17.235696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db47f-868a-4b6c-b7f1-1448079b2cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:17.235975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db47f-868a-4b6c-b7f1-1448079b2cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:17.236744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807db47f-868a-4b6c-b7f1-1448079b2cd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:17.237056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807db47f-868a-4b6c-b7f1-1448079b2cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:17.238672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807db47f-868a-4b6c-b7f1-1448079b2cd2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:17.249932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0faa8e-f2f8-4b61-b4d7-18494553c31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:17.250627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0faa8e-f2f8-4b61-b4d7-18494553c31a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:17.250907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0faa8e-f2f8-4b61-b4d7-18494553c31a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:17.251183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0faa8e-f2f8-4b61-b4d7-18494553c31a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:17.256285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 136/262] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:17.262537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807db47f-868a-4b6c-b7f1-1448079b2cd2 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:17.395878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0faa8e-f2f8-4b61-b4d7-18494553c31a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:17.396753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0faa8e-f2f8-4b61-b4d7-18494553c31a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:17.404314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807db47f-868a-4b6c-b7f1-1448079b2cd2 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:17.447999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc36ba-6bb3-4c98-ac74-68f23fcd72a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:17.448886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc36ba-6bb3-4c98-ac74-68f23fcd72a2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:17.449170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc36ba-6bb3-4c98-ac74-68f23fcd72a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:17.449445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc36ba-6bb3-4c98-ac74-68f23fcd72a2 None admin] PATH_INFO: `/v3/users/f150e3f076204aebb215cf81d41185b0` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:17.454369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc36ba-6bb3-4c98-ac74-68f23fcd72a2 None admin] RBAC: Authorizing `identity:get_user(user_id=f150e3f076204aebb215cf81d41185b0)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:17.455863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc36ba-6bb3-4c98-ac74-68f23fcd72a2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:17.457773 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 137/263] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:17 2022] GET /identity/v3/users/f150e3f076204aebb215cf81d41185b0 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:17.468480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc36ba-6bb3-4c98-ac74-68f23fcd72a2 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:17.549071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 127/264] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:17.554815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0faa8e-f2f8-4b61-b4d7-18494553c31a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:17.702726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc36ba-6bb3-4c98-ac74-68f23fcd72a2 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:17.757283 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0faa8e-f2f8-4b61-b4d7-18494553c31a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:17.787614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79891-937f-4503-88d0-c4f53f80b21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:17.788273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79891-937f-4503-88d0-c4f53f80b21d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:17.788547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79891-937f-4503-88d0-c4f53f80b21d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:17.788815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79891-937f-4503-88d0-c4f53f80b21d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:17.806304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576242c3-fa83-4555-aac7-a1a5acceb4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:17.807874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576242c3-fa83-4555-aac7-a1a5acceb4b1 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:17.808402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576242c3-fa83-4555-aac7-a1a5acceb4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:17.808880 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576242c3-fa83-4555-aac7-a1a5acceb4b1 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:17.810340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576242c3-fa83-4555-aac7-a1a5acceb4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:17.811981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576242c3-fa83-4555-aac7-a1a5acceb4b1 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:17.823640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 128/265] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:17 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:17.829682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576242c3-fa83-4555-aac7-a1a5acceb4b1 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:17.951061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff79891-937f-4503-88d0-c4f53f80b21d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:17.952593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff79891-937f-4503-88d0-c4f53f80b21d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:17.979319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576242c3-fa83-4555-aac7-a1a5acceb4b1 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:18.068014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1164bd5-e5fd-463f-bf11-0e577b86297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:18.068674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1164bd5-e5fd-463f-bf11-0e577b86297d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:18.068941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1164bd5-e5fd-463f-bf11-0e577b86297d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:18.069215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1164bd5-e5fd-463f-bf11-0e577b86297d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:18.070060 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1164bd5-e5fd-463f-bf11-0e577b86297d None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=aae7a29125d84943bd6b641569d01895, user.id=f150e3f076204aebb215cf81d41185b0) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:18.070372 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1164bd5-e5fd-463f-bf11-0e577b86297d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:18.071208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 138/266] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:18.072680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1164bd5-e5fd-463f-bf11-0e577b86297d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:18.073176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148bb13-910f-4e29-adc9-5acbc61c5781 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:18.073463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148bb13-910f-4e29-adc9-5acbc61c5781 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:18.073737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148bb13-910f-4e29-adc9-5acbc61c5781 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:18.075437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 139/267] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:18.077334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148bb13-910f-4e29-adc9-5acbc61c5781 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:18.086709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 129/268] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:17 2022] GET /identity/v3/role_assignments?user.id=f150e3f076204aebb215cf81d41185b0&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:18.099569 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb30eb-2ff6-4414-8f0e-45305ebfb500 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:18.099878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb30eb-2ff6-4414-8f0e-45305ebfb500 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:18.100116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb30eb-2ff6-4414-8f0e-45305ebfb500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:18.151239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-b1bb30eb-2ff6-4414-8f0e-45305ebfb500 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:18.152436 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b1bb30eb-2ff6-4414-8f0e-45305ebfb500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:18.255780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148bb13-910f-4e29-adc9-5acbc61c5781 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:18.338760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aa7ec-53be-498a-a7d1-044191640bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:18.339653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aa7ec-53be-498a-a7d1-044191640bdc None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:18.339980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aa7ec-53be-498a-a7d1-044191640bdc None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:18.340201 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aa7ec-53be-498a-a7d1-044191640bdc None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:18.341502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aa7ec-53be-498a-a7d1-044191640bdc None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:18.343003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aa7ec-53be-498a-a7d1-044191640bdc None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:18.344808 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 130/269] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:18.349665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 140/270] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:18 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:18.351065 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb30eb-2ff6-4414-8f0e-45305ebfb500 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:18.400457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aa7ec-53be-498a-a7d1-044191640bdc None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:18.525421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb30eb-2ff6-4414-8f0e-45305ebfb500 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:18.598027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5680ca-f64f-4fae-8997-32f902117481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:18.598713 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5680ca-f64f-4fae-8997-32f902117481 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:18.598993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5680ca-f64f-4fae-8997-32f902117481 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:18.599265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5680ca-f64f-4fae-8997-32f902117481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:18.600102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5680ca-f64f-4fae-8997-32f902117481 None admin] RBAC: Adding query filter params (role.id=e83d49af62db4f4aa2dcadb10a82bfdc, scope.project.id=aae7a29125d84943bd6b641569d01895, user.id=f150e3f076204aebb215cf81d41185b0) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:18.600409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5680ca-f64f-4fae-8997-32f902117481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:18.601857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5680ca-f64f-4fae-8997-32f902117481 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:18.606589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aa7ec-53be-498a-a7d1-044191640bdc None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:18.613358 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 131/271] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:18 2022] GET /identity/v3/role_assignments?user.id=f150e3f076204aebb215cf81d41185b0&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=e83d49af62db4f4aa2dcadb10a82bfdc => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:18.658966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426be2b-a26b-4d30-b59a-48c1ae62578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:18.659784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426be2b-a26b-4d30-b59a-48c1ae62578f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:18.660062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426be2b-a26b-4d30-b59a-48c1ae62578f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:18.660334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426be2b-a26b-4d30-b59a-48c1ae62578f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:18.674562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9858-539e-4f36-ba9e-044578b1429f None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:18.674977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9858-539e-4f36-ba9e-044578b1429f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:18.675261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9858-539e-4f36-ba9e-044578b1429f None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:18.677154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426be2b-a26b-4d30-b59a-48c1ae62578f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:18.677501 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 132/272] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:18.684876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb4152-556d-42bd-87d2-b3b45958cec4 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:18.685079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-5426be2b-a26b-4d30-b59a-48c1ae62578f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:18.685161 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb4152-556d-42bd-87d2-b3b45958cec4 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:18.685456 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb4152-556d-42bd-87d2-b3b45958cec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:18.686151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 141/273] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:18.691934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426be2b-a26b-4d30-b59a-48c1ae62578f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:18.713227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-c0eb4152-556d-42bd-87d2-b3b45958cec4 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:18.714416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c0eb4152-556d-42bd-87d2-b3b45958cec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:18.825600 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 133/274] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:18.836278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426be2b-a26b-4d30-b59a-48c1ae62578f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:18.873908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb4152-556d-42bd-87d2-b3b45958cec4 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:18.884415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3075d5-c92f-435a-9306-14506cf34f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:18.885246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3075d5-c92f-435a-9306-14506cf34f50 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:18.885774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3075d5-c92f-435a-9306-14506cf34f50 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:18.886624 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3075d5-c92f-435a-9306-14506cf34f50 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:18.887386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3075d5-c92f-435a-9306-14506cf34f50 None admin] RBAC: Adding query filter params (name=member) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:18.887803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3075d5-c92f-435a-9306-14506cf34f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:18.889619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3075d5-c92f-435a-9306-14506cf34f50 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:18.901868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 142/275] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:18.908512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3075d5-c92f-435a-9306-14506cf34f50 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:18.998967 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb4152-556d-42bd-87d2-b3b45958cec4 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:19.038243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3075d5-c92f-435a-9306-14506cf34f50 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:19.042768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8babd-67d5-4e73-8542-9e4986681ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:19.043577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8babd-67d5-4e73-8542-9e4986681ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:19.043853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8babd-67d5-4e73-8542-9e4986681ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:19.044125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8babd-67d5-4e73-8542-9e4986681ff7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:19.045318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8babd-67d5-4e73-8542-9e4986681ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:19.047263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8babd-67d5-4e73-8542-9e4986681ff7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:19.049584 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 134/276] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:19.054818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8babd-67d5-4e73-8542-9e4986681ff7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:19.087693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0d67-7990-4548-a331-1cf5dea332fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:19.089166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0d67-7990-4548-a331-1cf5dea332fb None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:19.089719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0d67-7990-4548-a331-1cf5dea332fb None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:19.090030 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0d67-7990-4548-a331-1cf5dea332fb None admin] PATH_INFO: `/v3/users/98ba95e6634a42d593164f8be3a4f246` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:19.106636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d0d67-7990-4548-a331-1cf5dea332fb None admin] RBAC: Authorizing `identity:get_user(user_id=98ba95e6634a42d593164f8be3a4f246)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:19.108110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d0d67-7990-4548-a331-1cf5dea332fb None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:19.109906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 143/277] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:18 2022] GET /identity/v3/users/98ba95e6634a42d593164f8be3a4f246 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:19.116011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0d67-7990-4548-a331-1cf5dea332fb None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:19.175618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8babd-67d5-4e73-8542-9e4986681ff7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:19.214973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b46cc7-ae86-48a0-b22c-6efc2ccc7ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:19.215645 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b46cc7-ae86-48a0-b22c-6efc2ccc7ca7 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:19.215976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b46cc7-ae86-48a0-b22c-6efc2ccc7ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:19.216249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b46cc7-ae86-48a0-b22c-6efc2ccc7ca7 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:19.217008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b46cc7-ae86-48a0-b22c-6efc2ccc7ca7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:19.220054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b46cc7-ae86-48a0-b22c-6efc2ccc7ca7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:19.240241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0d67-7990-4548-a331-1cf5dea332fb None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:19.276002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fac40-32af-47a6-bdd2-05b72ed44eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:19.276680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fac40-32af-47a6-bdd2-05b72ed44eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:19.277089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fac40-32af-47a6-bdd2-05b72ed44eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:19.277374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fac40-32af-47a6-bdd2-05b72ed44eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:19.278218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fac40-32af-47a6-bdd2-05b72ed44eb9 None admin] RBAC: Adding query filter params (role.id=b15932e4d63b437eb478fd41d0ae6ec6, user.id=98ba95e6634a42d593164f8be3a4f246, scope.system=all) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:19.278526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fac40-32af-47a6-bdd2-05b72ed44eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:19.279947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fac40-32af-47a6-bdd2-05b72ed44eb9 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:19.285558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 144/278] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Feb 28 21:35:19 2022] GET /identity/v3/role_assignments?user.id=98ba95e6634a42d593164f8be3a4f246&scope.system=all&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:19.316202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 135/279] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:35:19 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:35:19.560409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776627f-fc89-4b22-9a5e-b04c42fabb33 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:19.560745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776627f-fc89-4b22-9a5e-b04c42fabb33 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:19.560928 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776627f-fc89-4b22-9a5e-b04c42fabb33 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:19.562810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 145/280] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:19.568963 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28259-eca6-48f3-ad63-d7bc6235078a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:19.569261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28259-eca6-48f3-ad63-d7bc6235078a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:19.569540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28259-eca6-48f3-ad63-d7bc6235078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:19.591899 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-eed28259-eca6-48f3-ad63-d7bc6235078a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:19.593099 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-eed28259-eca6-48f3-ad63-d7bc6235078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:19.666369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 136/281] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:19.692716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776627f-fc89-4b22-9a5e-b04c42fabb33 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:19.810713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776627f-fc89-4b22-9a5e-b04c42fabb33 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:19.869110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca5b53-dddc-4cb4-8b39-2429a9684cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:19.869917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca5b53-dddc-4cb4-8b39-2429a9684cb6 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:19.870221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca5b53-dddc-4cb4-8b39-2429a9684cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:19.870497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca5b53-dddc-4cb4-8b39-2429a9684cb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:19.888402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca5b53-dddc-4cb4-8b39-2429a9684cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:19.899206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-bcca5b53-dddc-4cb4-8b39-2429a9684cb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 21:35:19.901315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 146/282] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:19.909159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed28259-eca6-48f3-ad63-d7bc6235078a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:20.020434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed28259-eca6-48f3-ad63-d7bc6235078a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:20.061712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff2096-78f7-41e0-a0df-96f3fdc4644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:20.062757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff2096-78f7-41e0-a0df-96f3fdc4644f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:20.063242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff2096-78f7-41e0-a0df-96f3fdc4644f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:20.063714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff2096-78f7-41e0-a0df-96f3fdc4644f None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:20.064733 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff2096-78f7-41e0-a0df-96f3fdc4644f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:20.065234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff2096-78f7-41e0-a0df-96f3fdc4644f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:20.066821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff2096-78f7-41e0-a0df-96f3fdc4644f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:20.076611 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 137/283] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:20.082503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca5b53-dddc-4cb4-8b39-2429a9684cb6 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:20.244186 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca5b53-dddc-4cb4-8b39-2429a9684cb6 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:20.289039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a5505-adf3-4a95-b520-654b96f6d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:20.289917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a5505-adf3-4a95-b520-654b96f6d9e2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:20.290667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a5505-adf3-4a95-b520-654b96f6d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:20.290958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a5505-adf3-4a95-b520-654b96f6d9e2 None admin] PATH_INFO: `/v3/users/6b14099900ad45f5913d64886cef55c2` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:20.292196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a5505-adf3-4a95-b520-654b96f6d9e2 None admin] RBAC: Authorizing `identity:get_user(user_id=6b14099900ad45f5913d64886cef55c2)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:20.293655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a5505-adf3-4a95-b520-654b96f6d9e2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:20.295319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 147/284] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:20 2022] GET /identity/v3/users/6b14099900ad45f5913d64886cef55c2 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:20.301192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff2096-78f7-41e0-a0df-96f3fdc4644f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:20.398420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcade5-e367-4e8c-957f-54e9044850b2 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:20.398747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcade5-e367-4e8c-957f-54e9044850b2 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:20.398973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcade5-e367-4e8c-957f-54e9044850b2 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:20.404328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 148/285] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:20.414515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f4de-c5db-44dc-8530-580eaca901dd None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:20.414797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f4de-c5db-44dc-8530-580eaca901dd None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:20.415123 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117f4de-c5db-44dc-8530-580eaca901dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:20.441289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-6117f4de-c5db-44dc-8530-580eaca901dd None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:20.443908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-6117f4de-c5db-44dc-8530-580eaca901dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:20.472002 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff2096-78f7-41e0-a0df-96f3fdc4644f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:20.541539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff105a31-1604-4d43-88f7-97174e9d00e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:20.542437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff105a31-1604-4d43-88f7-97174e9d00e9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:20.542716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff105a31-1604-4d43-88f7-97174e9d00e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:20.542984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff105a31-1604-4d43-88f7-97174e9d00e9 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:20.546402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff105a31-1604-4d43-88f7-97174e9d00e9 None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:20.547866 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff105a31-1604-4d43-88f7-97174e9d00e9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:20.549834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 138/286] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:20 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:20.555417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 149/287] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:20.556732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff105a31-1604-4d43-88f7-97174e9d00e9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:20.583112 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f4de-c5db-44dc-8530-580eaca901dd None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:20.684974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff105a31-1604-4d43-88f7-97174e9d00e9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:20.731269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6b20e-406d-49f3-bf0c-71c20e87f78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:20.732181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b20e-406d-49f3-bf0c-71c20e87f78c None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:20.732462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b20e-406d-49f3-bf0c-71c20e87f78c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:20.732739 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b20e-406d-49f3-bf0c-71c20e87f78c None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895/users/6b14099900ad45f5913d64886cef55c2/roles/2151a047bd9744e5be942a6bbd8c0f28` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:20.739308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6b20e-406d-49f3-bf0c-71c20e87f78c None admin] RBAC: Authorizing `identity:create_grant(project_id=aae7a29125d84943bd6b641569d01895, user_id=6b14099900ad45f5913d64886cef55c2, role_id=2151a047bd9744e5be942a6bbd8c0f28)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:20.740783 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6b20e-406d-49f3-bf0c-71c20e87f78c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:20.754411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117f4de-c5db-44dc-8530-580eaca901dd None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:20.788324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c632d9-59aa-40a4-b723-18ae465bda1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:20.789171 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c632d9-59aa-40a4-b723-18ae465bda1b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:20.789466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c632d9-59aa-40a4-b723-18ae465bda1b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:20.789728 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c632d9-59aa-40a4-b723-18ae465bda1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:20.800698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c632d9-59aa-40a4-b723-18ae465bda1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:20.808144 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-08c632d9-59aa-40a4-b723-18ae465bda1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:20.811287 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 150/288] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:20.816092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c632d9-59aa-40a4-b723-18ae465bda1b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:20.822033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 139/289] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:35:20 2022] PUT /identity/v3/projects/aae7a29125d84943bd6b641569d01895/users/6b14099900ad45f5913d64886cef55c2/roles/2151a047bd9744e5be942a6bbd8c0f28 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:20.927268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c632d9-59aa-40a4-b723-18ae465bda1b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:20.964439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aded6-67e5-4ffa-a05c-4f139f0d10d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:20.965036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aded6-67e5-4ffa-a05c-4f139f0d10d2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:20.965322 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aded6-67e5-4ffa-a05c-4f139f0d10d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:20.965598 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328aded6-67e5-4ffa-a05c-4f139f0d10d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:20.966390 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aded6-67e5-4ffa-a05c-4f139f0d10d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:20.966698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aded6-67e5-4ffa-a05c-4f139f0d10d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:20.968095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328aded6-67e5-4ffa-a05c-4f139f0d10d2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:20.977300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 151/290] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:20.983813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6b20e-406d-49f3-bf0c-71c20e87f78c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:21.110525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6b20e-406d-49f3-bf0c-71c20e87f78c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:21.150709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05b7cc-dd6b-4a80-a67a-c0815f0c419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:21.151592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05b7cc-dd6b-4a80-a67a-c0815f0c419e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:21.151873 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05b7cc-dd6b-4a80-a67a-c0815f0c419e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:21.152146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05b7cc-dd6b-4a80-a67a-c0815f0c419e None admin] PATH_INFO: `/v3/users/92a7d09c47354a7898261a6ad910cfbd` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:21.153383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05b7cc-dd6b-4a80-a67a-c0815f0c419e None admin] RBAC: Authorizing `identity:get_user(user_id=92a7d09c47354a7898261a6ad910cfbd)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:21.154875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05b7cc-dd6b-4a80-a67a-c0815f0c419e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:21.156679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 140/291] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:20 2022] GET /identity/v3/users/92a7d09c47354a7898261a6ad910cfbd => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:21.162183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aded6-67e5-4ffa-a05c-4f139f0d10d2 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:21.270211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328aded6-67e5-4ffa-a05c-4f139f0d10d2 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:21.304520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4e2ed-a3d5-4519-a15a-d6bf3662c0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:21.305153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e2ed-a3d5-4519-a15a-d6bf3662c0b2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:21.305438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e2ed-a3d5-4519-a15a-d6bf3662c0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:21.306273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4e2ed-a3d5-4519-a15a-d6bf3662c0b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:21.374982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4e2ed-a3d5-4519-a15a-d6bf3662c0b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:21.376449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4e2ed-a3d5-4519-a15a-d6bf3662c0b2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:21.476372 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 152/292] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:21.482201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05b7cc-dd6b-4a80-a67a-c0815f0c419e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:21.595278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05b7cc-dd6b-4a80-a67a-c0815f0c419e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:21.640723 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54008330-62c8-42ee-9fa5-2180e4739dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:21.641596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54008330-62c8-42ee-9fa5-2180e4739dae None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:21.641875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54008330-62c8-42ee-9fa5-2180e4739dae None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:21.642183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54008330-62c8-42ee-9fa5-2180e4739dae None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:21.643366 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54008330-62c8-42ee-9fa5-2180e4739dae None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:21.644817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54008330-62c8-42ee-9fa5-2180e4739dae None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:21.646536 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 141/293] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:21 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:21.652725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4e2ed-a3d5-4519-a15a-d6bf3662c0b2 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:21.779992 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4e2ed-a3d5-4519-a15a-d6bf3662c0b2 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:21.814689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a1425-9d99-4f19-89f7-aa45daf8f421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:21.815718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1425-9d99-4f19-89f7-aa45daf8f421 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:21.816194 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1425-9d99-4f19-89f7-aa45daf8f421 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:21.826438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1425-9d99-4f19-89f7-aa45daf8f421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:21.826438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1425-9d99-4f19-89f7-aa45daf8f421 None admin] RBAC: Adding query filter params (role.id=b15932e4d63b437eb478fd41d0ae6ec6, scope.project.id=aae7a29125d84943bd6b641569d01895, user.id=92a7d09c47354a7898261a6ad910cfbd) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:21.826438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1425-9d99-4f19-89f7-aa45daf8f421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:21.826438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1425-9d99-4f19-89f7-aa45daf8f421 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:21.830403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 153/294] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:21 2022] GET /identity/v3/role_assignments?user.id=92a7d09c47354a7898261a6ad910cfbd&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:22.003961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e844c6-b62b-4f8b-90e1-599ea9d89569 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.004469 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e844c6-b62b-4f8b-90e1-599ea9d89569 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.004540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e844c6-b62b-4f8b-90e1-599ea9d89569 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.006616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 142/295] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:22.012689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d182a4-6b93-48f0-8365-6f39722bfbbc None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.013163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d182a4-6b93-48f0-8365-6f39722bfbbc None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.013254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d182a4-6b93-48f0-8365-6f39722bfbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.037004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-13d182a4-6b93-48f0-8365-6f39722bfbbc None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:22.038240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-13d182a4-6b93-48f0-8365-6f39722bfbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:22.119377 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 154/296] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:22.142517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e844c6-b62b-4f8b-90e1-599ea9d89569 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:22.250520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e844c6-b62b-4f8b-90e1-599ea9d89569 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:22.291761 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc6642-5283-4185-a5e3-5c1e42c42ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:22.292608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6642-5283-4185-a5e3-5c1e42c42ec4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.292883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6642-5283-4185-a5e3-5c1e42c42ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.293147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6642-5283-4185-a5e3-5c1e42c42ec4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.304958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc6642-5283-4185-a5e3-5c1e42c42ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:22.312219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-3cfc6642-5283-4185-a5e3-5c1e42c42ec4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:22.313805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 143/297] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:22.319528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d182a4-6b93-48f0-8365-6f39722bfbbc None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:22.425929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d182a4-6b93-48f0-8365-6f39722bfbbc None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:22.464360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ff683-1361-43f5-955d-2a094174dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:22.465056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ff683-1361-43f5-955d-2a094174dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.465331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ff683-1361-43f5-955d-2a094174dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.465601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ff683-1361-43f5-955d-2a094174dcb4 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.466409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ff683-1361-43f5-955d-2a094174dcb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:22.466711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ff683-1361-43f5-955d-2a094174dcb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:22.468144 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ff683-1361-43f5-955d-2a094174dcb4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:22.475211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781100dd-de31-456a-8fef-fa8739a60b1e None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.475495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781100dd-de31-456a-8fef-fa8739a60b1e None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.475756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781100dd-de31-456a-8fef-fa8739a60b1e None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.478133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 144/298] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:22.480291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 155/299] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:22.486023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecd4f5-4ae4-4d66-9bf7-cff12c4a6539 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.486023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecd4f5-4ae4-4d66-9bf7-cff12c4a6539 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.486023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecd4f5-4ae4-4d66-9bf7-cff12c4a6539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.487154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ff683-1361-43f5-955d-2a094174dcb4 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:22.504249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-23ecd4f5-4ae4-4d66-9bf7-cff12c4a6539 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:22.505419 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-23ecd4f5-4ae4-4d66-9bf7-cff12c4a6539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:22.588886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 145/300] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:22.595891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ff683-1361-43f5-955d-2a094174dcb4 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:22.611932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecd4f5-4ae4-4d66-9bf7-cff12c4a6539 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:22.636725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f3e5-bd3a-42a4-9f7b-95788f981cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:22.637601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f3e5-bd3a-42a4-9f7b-95788f981cb5 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.637880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f3e5-bd3a-42a4-9f7b-95788f981cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.638435 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f3e5-bd3a-42a4-9f7b-95788f981cb5 None admin] PATH_INFO: `/v3/users/98ba95e6634a42d593164f8be3a4f246` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.639389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9f3e5-bd3a-42a4-9f7b-95788f981cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=98ba95e6634a42d593164f8be3a4f246)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:22.640828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9f3e5-bd3a-42a4-9f7b-95788f981cb5 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:22.642674 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 156/301] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:22 2022] GET /identity/v3/users/98ba95e6634a42d593164f8be3a4f246 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:22.643642 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2638e-9c38-4337-aa2b-ebdf8e9545cd None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.643926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2638e-9c38-4337-aa2b-ebdf8e9545cd None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.644199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2638e-9c38-4337-aa2b-ebdf8e9545cd None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.645800 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 157/302] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:22.651037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2638e-9c38-4337-aa2b-ebdf8e9545cd None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:22.715798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecd4f5-4ae4-4d66-9bf7-cff12c4a6539 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:22.748726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f852-0711-460f-affc-7cfa2eaadeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:22.749519 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f852-0711-460f-affc-7cfa2eaadeaf None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.749806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f852-0711-460f-affc-7cfa2eaadeaf None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.750113 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f852-0711-460f-affc-7cfa2eaadeaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.758188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2638e-9c38-4337-aa2b-ebdf8e9545cd None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:22.760859 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75f852-0711-460f-affc-7cfa2eaadeaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:22.767883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-ed75f852-0711-460f-affc-7cfa2eaadeaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 21:35:22.769278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 146/303] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:22.775458 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfd6f-1aa5-4fba-9792-70841ae84b34 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.775748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfd6f-1aa5-4fba-9792-70841ae84b34 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.776028 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bfd6f-1aa5-4fba-9792-70841ae84b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.791823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb8ebf-30bf-49c7-99d7-c94b72223ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:22.792002 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8c6bfd6f-1aa5-4fba-9792-70841ae84b34 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:22.792682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8ebf-30bf-49c7-99d7-c94b72223ceb None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:22.792964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8ebf-30bf-49c7-99d7-c94b72223ceb None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:22.793142 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8c6bfd6f-1aa5-4fba-9792-70841ae84b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:22.793237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb8ebf-30bf-49c7-99d7-c94b72223ceb None admin] PATH_INFO: `/v3/system/users/98ba95e6634a42d593164f8be3a4f246/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:22.794724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb8ebf-30bf-49c7-99d7-c94b72223ceb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=98ba95e6634a42d593164f8be3a4f246, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:22.796202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb8ebf-30bf-49c7-99d7-c94b72223ceb None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:22.858437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 147/304] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:22.870298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bfd6f-1aa5-4fba-9792-70841ae84b34 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:22.903488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 158/305] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Feb 28 21:35:22 2022] PUT /identity/v3/system/users/98ba95e6634a42d593164f8be3a4f246/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:22.912568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb8ebf-30bf-49c7-99d7-c94b72223ceb None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:22.984899 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bfd6f-1aa5-4fba-9792-70841ae84b34 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:23.027945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a192f2f-5a1f-42cc-90ff-4c6100719cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:23.029319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192f2f-5a1f-42cc-90ff-4c6100719cde None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:23.029744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192f2f-5a1f-42cc-90ff-4c6100719cde None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:23.030312 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192f2f-5a1f-42cc-90ff-4c6100719cde None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:23.031269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a192f2f-5a1f-42cc-90ff-4c6100719cde None admin] RBAC: Adding query filter params (name=reader) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:23.031733 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a192f2f-5a1f-42cc-90ff-4c6100719cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:23.033351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a192f2f-5a1f-42cc-90ff-4c6100719cde None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:23.044014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 148/306] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:23.047534 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb8ebf-30bf-49c7-99d7-c94b72223ceb None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:23.050164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a192f2f-5a1f-42cc-90ff-4c6100719cde None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:23.088431 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078f806-5ea3-4a4f-a962-6cc5fa4af34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:23.090342 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078f806-5ea3-4a4f-a962-6cc5fa4af34e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:23.090555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078f806-5ea3-4a4f-a962-6cc5fa4af34e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:23.090999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078f806-5ea3-4a4f-a962-6cc5fa4af34e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:23.092244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078f806-5ea3-4a4f-a962-6cc5fa4af34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:23.093691 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078f806-5ea3-4a4f-a962-6cc5fa4af34e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:23.098817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 159/307] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:23.100699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078f806-5ea3-4a4f-a962-6cc5fa4af34e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:23.192488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a192f2f-5a1f-42cc-90ff-4c6100719cde None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:23.214021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078f806-5ea3-4a4f-a962-6cc5fa4af34e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:23.232908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d972864-7712-4be1-86fe-5c17b85b9b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:23.233796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972864-7712-4be1-86fe-5c17b85b9b20 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:23.234100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972864-7712-4be1-86fe-5c17b85b9b20 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:23.234370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d972864-7712-4be1-86fe-5c17b85b9b20 None admin] PATH_INFO: `/v3/users/e2b6e0eeb26c4576b163be3fb93cdff0` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:23.251896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d972864-7712-4be1-86fe-5c17b85b9b20 None admin] RBAC: Authorizing `identity:get_user(user_id=e2b6e0eeb26c4576b163be3fb93cdff0)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:23.253858 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d972864-7712-4be1-86fe-5c17b85b9b20 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:23.255931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 149/308] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:23 2022] GET /identity/v3/users/e2b6e0eeb26c4576b163be3fb93cdff0 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:23.261826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002c900-8bb4-4160-8df1-c856a36f2e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:23.262382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d972864-7712-4be1-86fe-5c17b85b9b20 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:23.262718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c900-8bb4-4160-8df1-c856a36f2e55 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:23.263036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c900-8bb4-4160-8df1-c856a36f2e55 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:23.263309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002c900-8bb4-4160-8df1-c856a36f2e55 None admin] PATH_INFO: `/v3/groups` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:23.263991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002c900-8bb4-4160-8df1-c856a36f2e55 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:23.265569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002c900-8bb4-4160-8df1-c856a36f2e55 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:23.348973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 160/309] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Feb 28 21:35:23 2022] POST /identity/v3/groups => generated 229 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:35:23.374062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d972864-7712-4be1-86fe-5c17b85b9b20 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:23.413979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac18a57-fd9a-4dbc-8c08-ca406bc95744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:23.414690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac18a57-fd9a-4dbc-8c08-ca406bc95744 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:23.415061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac18a57-fd9a-4dbc-8c08-ca406bc95744 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:23.415807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac18a57-fd9a-4dbc-8c08-ca406bc95744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:23.416780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac18a57-fd9a-4dbc-8c08-ca406bc95744 None admin] RBAC: Adding query filter params (role.id=2151a047bd9744e5be942a6bbd8c0f28, user.id=e2b6e0eeb26c4576b163be3fb93cdff0, scope.system=all) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:23.417095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac18a57-fd9a-4dbc-8c08-ca406bc95744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:23.418686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac18a57-fd9a-4dbc-8c08-ca406bc95744 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:23.429800 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 150/310] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Feb 28 21:35:23 2022] GET /identity/v3/role_assignments?user.id=e2b6e0eeb26c4576b163be3fb93cdff0&scope.system=all&role.id=2151a047bd9744e5be942a6bbd8c0f28 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:23.713271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed31a11-9cb2-4430-a026-4f35023ad62c None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:23.713954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed31a11-9cb2-4430-a026-4f35023ad62c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:23.714499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed31a11-9cb2-4430-a026-4f35023ad62c None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:23.716482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 161/311] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:23.722039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b374b-0c9a-43e8-ba69-6ceb59b5ca1e None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:23.722622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b374b-0c9a-43e8-ba69-6ceb59b5ca1e None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:23.723101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b374b-0c9a-43e8-ba69-6ceb59b5ca1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:23.740933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-699b374b-0c9a-43e8-ba69-6ceb59b5ca1e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:23.742490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-699b374b-0c9a-43e8-ba69-6ceb59b5ca1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:23.811691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 151/312] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:23.840558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed31a11-9cb2-4430-a026-4f35023ad62c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:23.948725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed31a11-9cb2-4430-a026-4f35023ad62c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:23.982267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823c92f-b6c4-46d3-bed5-cd4f7ce911aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:23.983366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823c92f-b6c4-46d3-bed5-cd4f7ce911aa None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:23.983967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823c92f-b6c4-46d3-bed5-cd4f7ce911aa None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:23.984435 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823c92f-b6c4-46d3-bed5-cd4f7ce911aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:23.994910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823c92f-b6c4-46d3-bed5-cd4f7ce911aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:24.003636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-4823c92f-b6c4-46d3-bed5-cd4f7ce911aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 21:35:24.005367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 162/313] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:24.012298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b374b-0c9a-43e8-ba69-6ceb59b5ca1e None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:24.114710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b374b-0c9a-43e8-ba69-6ceb59b5ca1e None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:24.150753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f805f7-dbde-4eb5-a13a-c5c77dcef0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:24.151800 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f805f7-dbde-4eb5-a13a-c5c77dcef0e4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:24.152295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f805f7-dbde-4eb5-a13a-c5c77dcef0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:24.152815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f805f7-dbde-4eb5-a13a-c5c77dcef0e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:24.153757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f805f7-dbde-4eb5-a13a-c5c77dcef0e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:24.154288 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f805f7-dbde-4eb5-a13a-c5c77dcef0e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:24.155854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f805f7-dbde-4eb5-a13a-c5c77dcef0e4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:24.164641 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 152/314] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:24.170383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823c92f-b6c4-46d3-bed5-cd4f7ce911aa None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:24.279289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823c92f-b6c4-46d3-bed5-cd4f7ce911aa None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:24.311968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652823f-1602-4c03-ab99-0a84d4066876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:24.312836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652823f-1602-4c03-ab99-0a84d4066876 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:24.313120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652823f-1602-4c03-ab99-0a84d4066876 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:24.313396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652823f-1602-4c03-ab99-0a84d4066876 None admin] PATH_INFO: `/v3/users/6b14099900ad45f5913d64886cef55c2` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:24.314629 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652823f-1602-4c03-ab99-0a84d4066876 None admin] RBAC: Authorizing `identity:get_user(user_id=6b14099900ad45f5913d64886cef55c2)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:24.316075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652823f-1602-4c03-ab99-0a84d4066876 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:24.317708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 163/315] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:24 2022] GET /identity/v3/users/6b14099900ad45f5913d64886cef55c2 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:24.323548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f805f7-dbde-4eb5-a13a-c5c77dcef0e4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:24.428118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f805f7-dbde-4eb5-a13a-c5c77dcef0e4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:24.463259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860a43-7dc4-486c-af4a-9df25091ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:24.464270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860a43-7dc4-486c-af4a-9df25091ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:24.464761 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860a43-7dc4-486c-af4a-9df25091ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:24.465232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5860a43-7dc4-486c-af4a-9df25091ebe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:24.534360 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5860a43-7dc4-486c-af4a-9df25091ebe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:24.536160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5860a43-7dc4-486c-af4a-9df25091ebe6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:24.642014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 153/316] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:24.650911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652823f-1602-4c03-ab99-0a84d4066876 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:24.751417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652823f-1602-4c03-ab99-0a84d4066876 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:24.785763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e0fec-4043-4f2c-bced-7df319bcfb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:24.786975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0fec-4043-4f2c-bced-7df319bcfb13 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:24.787474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0fec-4043-4f2c-bced-7df319bcfb13 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:24.787943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e0fec-4043-4f2c-bced-7df319bcfb13 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:24.789317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e0fec-4043-4f2c-bced-7df319bcfb13 None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:24.791544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e0fec-4043-4f2c-bced-7df319bcfb13 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:24.793438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 164/317] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:24 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:24.799404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860a43-7dc4-486c-af4a-9df25091ebe6 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:24.898824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5860a43-7dc4-486c-af4a-9df25091ebe6 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:24.936737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd45c1-737b-4cb0-8fe0-c97c274482cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:24.937412 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd45c1-737b-4cb0-8fe0-c97c274482cd None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:24.937694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd45c1-737b-4cb0-8fe0-c97c274482cd None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:24.937970 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd45c1-737b-4cb0-8fe0-c97c274482cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:24.938836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd45c1-737b-4cb0-8fe0-c97c274482cd None admin] RBAC: Adding query filter params (role.id=2151a047bd9744e5be942a6bbd8c0f28, scope.project.id=aae7a29125d84943bd6b641569d01895, user.id=6b14099900ad45f5913d64886cef55c2) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:24.939146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd45c1-737b-4cb0-8fe0-c97c274482cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:24.940585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd45c1-737b-4cb0-8fe0-c97c274482cd None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:24.954141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 154/318] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:24 2022] GET /identity/v3/role_assignments?user.id=6b14099900ad45f5913d64886cef55c2&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=2151a047bd9744e5be942a6bbd8c0f28 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:25.283973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280e31-be3a-4df7-ba6e-76ff664ea750 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:25.284492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280e31-be3a-4df7-ba6e-76ff664ea750 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:25.284492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280e31-be3a-4df7-ba6e-76ff664ea750 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:25.286325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 165/319] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:25.292581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34e79b-c217-4c58-a0f0-20a5b79fbc91 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:25.293048 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34e79b-c217-4c58-a0f0-20a5b79fbc91 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:25.293119 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34e79b-c217-4c58-a0f0-20a5b79fbc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:25.309384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6a34e79b-c217-4c58-a0f0-20a5b79fbc91 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:25.310577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6a34e79b-c217-4c58-a0f0-20a5b79fbc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:25.374022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 155/320] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:25.398043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280e31-be3a-4df7-ba6e-76ff664ea750 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:25.499949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280e31-be3a-4df7-ba6e-76ff664ea750 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:25.535267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aa364-2a5a-4d1b-8e91-10f8161a4a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:25.535973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aa364-2a5a-4d1b-8e91-10f8161a4a0c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:25.536249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aa364-2a5a-4d1b-8e91-10f8161a4a0c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:25.536514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aa364-2a5a-4d1b-8e91-10f8161a4a0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:25.546588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aa364-2a5a-4d1b-8e91-10f8161a4a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:25.553520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-0b2aa364-2a5a-4d1b-8e91-10f8161a4a0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:25.554920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 166/321] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:25.560586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34e79b-c217-4c58-a0f0-20a5b79fbc91 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:25.653035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34e79b-c217-4c58-a0f0-20a5b79fbc91 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:25.685064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c50940-8651-4180-a5a1-aee551451213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:25.685725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c50940-8651-4180-a5a1-aee551451213 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:25.686016 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c50940-8651-4180-a5a1-aee551451213 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:25.686300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c50940-8651-4180-a5a1-aee551451213 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:25.687177 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c50940-8651-4180-a5a1-aee551451213 None admin] RBAC: Adding query filter params (name=member) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:25.687365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c50940-8651-4180-a5a1-aee551451213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:25.688682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c50940-8651-4180-a5a1-aee551451213 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:25.696680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 156/322] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:25.702028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aa364-2a5a-4d1b-8e91-10f8161a4a0c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:25.799140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aa364-2a5a-4d1b-8e91-10f8161a4a0c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:25.808439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7765c-3cea-422f-ac58-1f6a628b1fa5 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:25.808732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7765c-3cea-422f-ac58-1f6a628b1fa5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:25.809015 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7765c-3cea-422f-ac58-1f6a628b1fa5 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:25.810967 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 157/323] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:25.819443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a978d-6bed-4e60-b1ec-f6516068e3ce None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:25.819979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a978d-6bed-4e60-b1ec-f6516068e3ce None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:25.829006 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a978d-6bed-4e60-b1ec-f6516068e3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:25.832931 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecd78e-1c34-4b47-a42e-13977e607e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:25.833802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecd78e-1c34-4b47-a42e-13977e607e44 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:25.834109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecd78e-1c34-4b47-a42e-13977e607e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:25.834379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecd78e-1c34-4b47-a42e-13977e607e44 None admin] PATH_INFO: `/v3/users/98ba95e6634a42d593164f8be3a4f246` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:25.835572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecd78e-1c34-4b47-a42e-13977e607e44 None admin] RBAC: Authorizing `identity:get_user(user_id=98ba95e6634a42d593164f8be3a4f246)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:25.837031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecd78e-1c34-4b47-a42e-13977e607e44 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:25.837807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-d72a978d-6bed-4e60-b1ec-f6516068e3ce None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:25.839007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d72a978d-6bed-4e60-b1ec-f6516068e3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:25.842317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 167/324] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:25 2022] GET /identity/v3/users/98ba95e6634a42d593164f8be3a4f246 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:25.844185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecd78e-1c34-4b47-a42e-13977e607e44 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:25.908538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 158/325] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:25.909870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e42b1-57c1-4c17-a3ce-5e9c409ad2a0 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:25.910185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e42b1-57c1-4c17-a3ce-5e9c409ad2a0 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:25.910517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e42b1-57c1-4c17-a3ce-5e9c409ad2a0 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:25.914022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 159/326] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:25.918130 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aea53-ea17-4436-b6a9-2ff5487bc4c1 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:25.919027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aea53-ea17-4436-b6a9-2ff5487bc4c1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:25.919483 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aea53-ea17-4436-b6a9-2ff5487bc4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:25.935908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-b43aea53-ea17-4436-b6a9-2ff5487bc4c1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:25.937082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b43aea53-ea17-4436-b6a9-2ff5487bc4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:25.941804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecd78e-1c34-4b47-a42e-13977e607e44 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:25.973334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ed248-54c0-4528-bd75-0ed5751ba22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:25.973976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ed248-54c0-4528-bd75-0ed5751ba22c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:25.974280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ed248-54c0-4528-bd75-0ed5751ba22c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:25.974552 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ed248-54c0-4528-bd75-0ed5751ba22c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:25.975372 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ed248-54c0-4528-bd75-0ed5751ba22c None admin] RBAC: Adding query filter params (role.id=b15932e4d63b437eb478fd41d0ae6ec6, user.id=98ba95e6634a42d593164f8be3a4f246, scope.system=all) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:25.975675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ed248-54c0-4528-bd75-0ed5751ba22c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:25.977091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ed248-54c0-4528-bd75-0ed5751ba22c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:25.988243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 168/327] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Feb 28 21:35:25 2022] GET /identity/v3/role_assignments?user.id=98ba95e6634a42d593164f8be3a4f246&scope.system=all&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 510 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:25.988948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ed248-54c0-4528-bd75-0ed5751ba22c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:26.002293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 160/328] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:26.025406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aea53-ea17-4436-b6a9-2ff5487bc4c1 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:26.096730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ed248-54c0-4528-bd75-0ed5751ba22c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:26.134503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aea53-ea17-4436-b6a9-2ff5487bc4c1 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:26.138951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1120cb-1878-4ae3-914a-6323ed55d553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:26.139761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1120cb-1878-4ae3-914a-6323ed55d553 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:26.140039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1120cb-1878-4ae3-914a-6323ed55d553 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:26.140307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1120cb-1878-4ae3-914a-6323ed55d553 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:26.152532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1120cb-1878-4ae3-914a-6323ed55d553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:26.159780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-9b1120cb-1878-4ae3-914a-6323ed55d553 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 21:35:26.161183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 169/329] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:26.168760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1120cb-1878-4ae3-914a-6323ed55d553 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:26.169889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec71f6-1809-4fa4-ac19-76a76c974dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:26.170712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec71f6-1809-4fa4-ac19-76a76c974dab None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:26.171702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec71f6-1809-4fa4-ac19-76a76c974dab None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:26.171702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec71f6-1809-4fa4-ac19-76a76c974dab None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:26.172432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec71f6-1809-4fa4-ac19-76a76c974dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:26.173867 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec71f6-1809-4fa4-ac19-76a76c974dab None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:26.175644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 161/330] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:26.181448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec71f6-1809-4fa4-ac19-76a76c974dab None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:26.277789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1120cb-1878-4ae3-914a-6323ed55d553 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:26.282149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec71f6-1809-4fa4-ac19-76a76c974dab None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:26.308911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af429-11ea-40e3-b651-3c7b52f6f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:26.309578 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af429-11ea-40e3-b651-3c7b52f6f66d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:26.309856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af429-11ea-40e3-b651-3c7b52f6f66d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:26.310159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af429-11ea-40e3-b651-3c7b52f6f66d None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:26.310899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af429-11ea-40e3-b651-3c7b52f6f66d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:26.311203 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af429-11ea-40e3-b651-3c7b52f6f66d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:26.312551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af429-11ea-40e3-b651-3c7b52f6f66d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:26.318535 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d576372-850d-4b68-9361-fdb7504bca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:26.319184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d576372-850d-4b68-9361-fdb7504bca0d None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:26.319465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d576372-850d-4b68-9361-fdb7504bca0d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:26.319736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d576372-850d-4b68-9361-fdb7504bca0d None admin] PATH_INFO: `/v3/groups` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:26.320408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d576372-850d-4b68-9361-fdb7504bca0d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:26.320535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 170/331] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:26.322486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d576372-850d-4b68-9361-fdb7504bca0d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:26.326470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af429-11ea-40e3-b651-3c7b52f6f66d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:26.416070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 162/332] 10.222.0.26 () {60 vars in 1134 bytes} [Mon Feb 28 21:35:26 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:35:26.419954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af429-11ea-40e3-b651-3c7b52f6f66d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:26.456405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc2d63-7d4b-4d24-b9cd-e2f3de5a3908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:26.457300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2d63-7d4b-4d24-b9cd-e2f3de5a3908 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:26.457576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2d63-7d4b-4d24-b9cd-e2f3de5a3908 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:26.457846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc2d63-7d4b-4d24-b9cd-e2f3de5a3908 None admin] PATH_INFO: `/v3/users/e2b6e0eeb26c4576b163be3fb93cdff0` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:26.459122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2d63-7d4b-4d24-b9cd-e2f3de5a3908 None admin] RBAC: Authorizing `identity:get_user(user_id=e2b6e0eeb26c4576b163be3fb93cdff0)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:26.460579 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc2d63-7d4b-4d24-b9cd-e2f3de5a3908 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:26.462364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 171/333] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:26 2022] GET /identity/v3/users/e2b6e0eeb26c4576b163be3fb93cdff0 => generated 293 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:26.468237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d576372-850d-4b68-9361-fdb7504bca0d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:26.568567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d576372-850d-4b68-9361-fdb7504bca0d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:26.601944 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f62a3-ba8a-44a3-b0ca-652648e87e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:26.602906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f62a3-ba8a-44a3-b0ca-652648e87e2a None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:26.603189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f62a3-ba8a-44a3-b0ca-652648e87e2a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:26.603486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f62a3-ba8a-44a3-b0ca-652648e87e2a None admin] PATH_INFO: `/v3/system/users/e2b6e0eeb26c4576b163be3fb93cdff0/roles/2151a047bd9744e5be942a6bbd8c0f28` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:26.605825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f62a3-ba8a-44a3-b0ca-652648e87e2a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e2b6e0eeb26c4576b163be3fb93cdff0, role_id=2151a047bd9744e5be942a6bbd8c0f28)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:26.606444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f62a3-ba8a-44a3-b0ca-652648e87e2a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:26.674788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 163/334] 10.222.0.26 () {58 vars in 1334 bytes} [Mon Feb 28 21:35:26 2022] PUT /identity/v3/system/users/e2b6e0eeb26c4576b163be3fb93cdff0/roles/2151a047bd9744e5be942a6bbd8c0f28 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:29.077359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d59e35-8bad-4628-8a2d-59a805ed344c None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:29.077870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d59e35-8bad-4628-8a2d-59a805ed344c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:29.077969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d59e35-8bad-4628-8a2d-59a805ed344c None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:29.080100 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 172/335] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:29.086024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8cdfc-ecc4-4a4c-b940-b43b4194bedf None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:29.087242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8cdfc-ecc4-4a4c-b940-b43b4194bedf None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:29.087717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8cdfc-ecc4-4a4c-b940-b43b4194bedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:29.116837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a4e8cdfc-ecc4-4a4c-b940-b43b4194bedf None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:29.116837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a4e8cdfc-ecc4-4a4c-b940-b43b4194bedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:29.201646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 164/336] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:29.237906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d59e35-8bad-4628-8a2d-59a805ed344c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:29.379744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d59e35-8bad-4628-8a2d-59a805ed344c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:29.422952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1164a-735f-4991-9938-a3b1880f6a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:29.423786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1164a-735f-4991-9938-a3b1880f6a3d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:29.424058 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1164a-735f-4991-9938-a3b1880f6a3d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:29.424334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1164a-735f-4991-9938-a3b1880f6a3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:29.437039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1164a-735f-4991-9938-a3b1880f6a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:29.444793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-3fc1164a-735f-4991-9938-a3b1880f6a3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:29.449054 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 173/337] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:29.455132 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8cdfc-ecc4-4a4c-b940-b43b4194bedf None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:29.591687 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8cdfc-ecc4-4a4c-b940-b43b4194bedf None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:29.637836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc0209-20db-4d9f-8d2a-5ead092414f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:29.638466 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc0209-20db-4d9f-8d2a-5ead092414f7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:29.638748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc0209-20db-4d9f-8d2a-5ead092414f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:29.639021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc0209-20db-4d9f-8d2a-5ead092414f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:29.639778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc0209-20db-4d9f-8d2a-5ead092414f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:29.640085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc0209-20db-4d9f-8d2a-5ead092414f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:29.641462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc0209-20db-4d9f-8d2a-5ead092414f7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:29.653823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 165/338] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:29.659412 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1164a-735f-4991-9938-a3b1880f6a3d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:29.833498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068a741-8984-44e1-9b26-9fffb0e377a4 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:29.833859 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068a741-8984-44e1-9b26-9fffb0e377a4 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:29.834108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068a741-8984-44e1-9b26-9fffb0e377a4 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:29.835908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 166/339] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:29.857043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cecbf-c2f2-4740-99b2-949a1294e9a9 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:29.857043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cecbf-c2f2-4740-99b2-949a1294e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:29.857043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cecbf-c2f2-4740-99b2-949a1294e9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:29.859661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1164a-735f-4991-9938-a3b1880f6a3d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:29.885981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-906cecbf-c2f2-4740-99b2-949a1294e9a9 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:29.887673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-906cecbf-c2f2-4740-99b2-949a1294e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:29.929455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d06b1-eb59-4cc4-b619-5667e88de8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:29.930103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d06b1-eb59-4cc4-b619-5667e88de8d2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:29.930593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d06b1-eb59-4cc4-b619-5667e88de8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:29.930979 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d06b1-eb59-4cc4-b619-5667e88de8d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:29.989513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 167/340] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:29.991024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c055b9-4602-404f-af68-525cf8f57ce3 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:29.991312 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c055b9-4602-404f-af68-525cf8f57ce3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:29.991592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c055b9-4602-404f-af68-525cf8f57ce3 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:29.993337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 168/341] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:29.994467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31426ad-1832-41a8-bd19-3b8b1872e960 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:29.994812 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31426ad-1832-41a8-bd19-3b8b1872e960 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:29.995090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31426ad-1832-41a8-bd19-3b8b1872e960 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:29.996947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 169/342] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:30.002267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccd16-0a23-44b2-847e-972d128714c3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:30.002556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccd16-0a23-44b2-847e-972d128714c3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:30.002837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccd16-0a23-44b2-847e-972d128714c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:30.018964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d06b1-eb59-4cc4-b619-5667e88de8d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:30.020558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d06b1-eb59-4cc4-b619-5667e88de8d2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:30.020877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-e02ccd16-0a23-44b2-847e-972d128714c3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:30.022106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e02ccd16-0a23-44b2-847e-972d128714c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:30.129957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 174/343] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:30.131487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daef816-e92f-45e9-88ea-f8da845e776a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:30.131776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daef816-e92f-45e9-88ea-f8da845e776a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:30.132050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daef816-e92f-45e9-88ea-f8da845e776a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:30.151632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-1daef816-e92f-45e9-88ea-f8da845e776a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:30.152847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1daef816-e92f-45e9-88ea-f8da845e776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:30.216665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 170/344] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:30.217451 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ccd16-0a23-44b2-847e-972d128714c3 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:30.223672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 175/345] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:30.224523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daef816-e92f-45e9-88ea-f8da845e776a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:30.351488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daef816-e92f-45e9-88ea-f8da845e776a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:30.356318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ccd16-0a23-44b2-847e-972d128714c3 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:30.391540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c93118-f4fd-4463-bda9-ff79ed104209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:30.392758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c93118-f4fd-4463-bda9-ff79ed104209 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:30.393231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c93118-f4fd-4463-bda9-ff79ed104209 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:30.393715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c93118-f4fd-4463-bda9-ff79ed104209 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:30.395195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c93118-f4fd-4463-bda9-ff79ed104209 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:30.396821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c93118-f4fd-4463-bda9-ff79ed104209 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:30.399623 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 176/346] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:30 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:30.400703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c93118-f4fd-4463-bda9-ff79ed104209 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:30.401001 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d5f2d-17a2-4b62-898f-3643ddc13012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:30.402726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5f2d-17a2-4b62-898f-3643ddc13012 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:30.402726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5f2d-17a2-4b62-898f-3643ddc13012 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:30.402726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d5f2d-17a2-4b62-898f-3643ddc13012 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:30.416354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d5f2d-17a2-4b62-898f-3643ddc13012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:30.425618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-c95d5f2d-17a2-4b62-898f-3643ddc13012 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:30.427381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 171/347] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:30.428463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d5f2d-17a2-4b62-898f-3643ddc13012 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:30.518722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c93118-f4fd-4463-bda9-ff79ed104209 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:30.555297 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1893c22-5d22-4070-ac5c-c6c4ac1cdd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:30.556470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1893c22-5d22-4070-ac5c-c6c4ac1cdd09 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:30.556961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1893c22-5d22-4070-ac5c-c6c4ac1cdd09 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:30.557421 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1893c22-5d22-4070-ac5c-c6c4ac1cdd09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:30.565700 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d5f2d-17a2-4b62-898f-3643ddc13012 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:30.569600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1893c22-5d22-4070-ac5c-c6c4ac1cdd09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:30.578167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a1893c22-5d22-4070-ac5c-c6c4ac1cdd09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 28 21:35:30.580218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 177/348] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:30.581273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1893c22-5d22-4070-ac5c-c6c4ac1cdd09 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:30.613141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d564a35-115c-42fc-9beb-8b2df3354e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:30.613671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d564a35-115c-42fc-9beb-8b2df3354e95 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:30.613952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d564a35-115c-42fc-9beb-8b2df3354e95 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:30.616963 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d564a35-115c-42fc-9beb-8b2df3354e95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:30.630595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d564a35-115c-42fc-9beb-8b2df3354e95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:30.640251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-4d564a35-115c-42fc-9beb-8b2df3354e95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:30.642135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 172/349] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:30.643348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d564a35-115c-42fc-9beb-8b2df3354e95 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:30.707724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1893c22-5d22-4070-ac5c-c6c4ac1cdd09 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:30.753481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6022b-26b6-4f6c-942a-b0b7af5641cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:30.753481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6022b-26b6-4f6c-942a-b0b7af5641cf None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:30.753481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6022b-26b6-4f6c-942a-b0b7af5641cf None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:30.753481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6022b-26b6-4f6c-942a-b0b7af5641cf None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:30.756093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d564a35-115c-42fc-9beb-8b2df3354e95 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:30.762436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6022b-26b6-4f6c-942a-b0b7af5641cf None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:30.763918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6022b-26b6-4f6c-942a-b0b7af5641cf None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:30.766107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 178/350] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:30 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:30.766988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6022b-26b6-4f6c-942a-b0b7af5641cf None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:30.802344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db25e7-888e-4e74-bd1d-9ad030621a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:30.802940 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db25e7-888e-4e74-bd1d-9ad030621a72 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:30.803219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db25e7-888e-4e74-bd1d-9ad030621a72 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:30.803492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db25e7-888e-4e74-bd1d-9ad030621a72 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:30.804421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db25e7-888e-4e74-bd1d-9ad030621a72 None admin] RBAC: Adding query filter params (name=member) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:30.804727 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db25e7-888e-4e74-bd1d-9ad030621a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:30.807181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db25e7-888e-4e74-bd1d-9ad030621a72 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:30.817465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 173/351] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:30.817893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db25e7-888e-4e74-bd1d-9ad030621a72 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:30.896964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6022b-26b6-4f6c-942a-b0b7af5641cf None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:30.937594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb2796-7fdf-4224-bbab-164643144697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:30.938644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2796-7fdf-4224-bbab-164643144697 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:30.939118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2796-7fdf-4224-bbab-164643144697 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:30.939599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2796-7fdf-4224-bbab-164643144697 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:30.940528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb2796-7fdf-4224-bbab-164643144697 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:30.941021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb2796-7fdf-4224-bbab-164643144697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:30.942683 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb2796-7fdf-4224-bbab-164643144697 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:30.942935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db25e7-888e-4e74-bd1d-9ad030621a72 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:30.954172 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 179/352] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:30.955460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb2796-7fdf-4224-bbab-164643144697 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:30.981323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eca627-0152-4e39-b745-03a876f74bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:30.982457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca627-0152-4e39-b745-03a876f74bdb None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:30.982934 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca627-0152-4e39-b745-03a876f74bdb None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:30.983547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca627-0152-4e39-b745-03a876f74bdb None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:30.984518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eca627-0152-4e39-b745-03a876f74bdb None admin] RBAC: Adding query filter params (name=member) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:30.985031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eca627-0152-4e39-b745-03a876f74bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:30.987512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eca627-0152-4e39-b745-03a876f74bdb None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:31.000003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 174/353] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:31.001304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eca627-0152-4e39-b745-03a876f74bdb None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:31.132841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eca627-0152-4e39-b745-03a876f74bdb None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:31.172378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe345c-5696-44a5-8ea6-7b0b2d27e835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:31.173015 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe345c-5696-44a5-8ea6-7b0b2d27e835 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:31.173294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe345c-5696-44a5-8ea6-7b0b2d27e835 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:31.173564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe345c-5696-44a5-8ea6-7b0b2d27e835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:31.205016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb2796-7fdf-4224-bbab-164643144697 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:31.245387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c47f2-6dd6-4d6c-aef1-8991961336e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:31.246373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c47f2-6dd6-4d6c-aef1-8991961336e1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:31.246660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c47f2-6dd6-4d6c-aef1-8991961336e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:31.246935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c47f2-6dd6-4d6c-aef1-8991961336e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:31.247798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c47f2-6dd6-4d6c-aef1-8991961336e1 None admin] RBAC: Adding query filter params (group.id=e37010764bde43a7aaf0ac545da4757d, role.id=e83d49af62db4f4aa2dcadb10a82bfdc, scope.project.id=7b3f655528294e62a0a33ce69e504013) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:31.248463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c47f2-6dd6-4d6c-aef1-8991961336e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:31.249543 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c47f2-6dd6-4d6c-aef1-8991961336e1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:31.251400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe345c-5696-44a5-8ea6-7b0b2d27e835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:31.252905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe345c-5696-44a5-8ea6-7b0b2d27e835 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:31.256627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 180/354] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Feb 28 21:35:30 2022] GET /identity/v3/role_assignments?group.id=e37010764bde43a7aaf0ac545da4757d&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=e83d49af62db4f4aa2dcadb10a82bfdc => generated 260 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:31.262025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c47f2-6dd6-4d6c-aef1-8991961336e1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:31.399591 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c47f2-6dd6-4d6c-aef1-8991961336e1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:31.406671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 175/355] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:31.406671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe345c-5696-44a5-8ea6-7b0b2d27e835 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:31.451365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f992996-c3d2-4340-b137-5f2c5fb90e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:31.452253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992996-c3d2-4340-b137-5f2c5fb90e93 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:31.452550 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992996-c3d2-4340-b137-5f2c5fb90e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:31.452813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992996-c3d2-4340-b137-5f2c5fb90e93 None admin] PATH_INFO: `/v3/users/e2b6e0eeb26c4576b163be3fb93cdff0` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:31.454851 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f992996-c3d2-4340-b137-5f2c5fb90e93 None admin] RBAC: Authorizing `identity:get_user(user_id=e2b6e0eeb26c4576b163be3fb93cdff0)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:31.456395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f992996-c3d2-4340-b137-5f2c5fb90e93 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:31.458369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 181/356] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:35:31 2022] GET /identity/v3/users/e2b6e0eeb26c4576b163be3fb93cdff0 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:31.459688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c35c7-f2b2-44d7-ac81-6e9e96fc708f None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:31.460041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c35c7-f2b2-44d7-ac81-6e9e96fc708f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:31.460320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c35c7-f2b2-44d7-ac81-6e9e96fc708f None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:31.463027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 182/357] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:31.464174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4632d5-3b95-43fb-8ac4-9a597dd809ba None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:31.464464 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4632d5-3b95-43fb-8ac4-9a597dd809ba None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:31.464900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4632d5-3b95-43fb-8ac4-9a597dd809ba None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:31.466556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 183/358] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:31.467248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4632d5-3b95-43fb-8ac4-9a597dd809ba None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:31.529042 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe345c-5696-44a5-8ea6-7b0b2d27e835 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:31.577713 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b18683-f64f-4a7f-8f78-294705cd1e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:31.578845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18683-f64f-4a7f-8f78-294705cd1e21 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:31.579133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18683-f64f-4a7f-8f78-294705cd1e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:31.579410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18683-f64f-4a7f-8f78-294705cd1e21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:31.599121 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4632d5-3b95-43fb-8ac4-9a597dd809ba None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:31.645624 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5688748-c162-4c6d-bf8d-3ca309d2e7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:31.646542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5688748-c162-4c6d-bf8d-3ca309d2e7f0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:31.646828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5688748-c162-4c6d-bf8d-3ca309d2e7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:31.647110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5688748-c162-4c6d-bf8d-3ca309d2e7f0 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:31.648293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5688748-c162-4c6d-bf8d-3ca309d2e7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:31.651410 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5688748-c162-4c6d-bf8d-3ca309d2e7f0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:31.655403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 184/359] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:31 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:31.655403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5688748-c162-4c6d-bf8d-3ca309d2e7f0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:31.678134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b18683-f64f-4a7f-8f78-294705cd1e21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:31.679726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b18683-f64f-4a7f-8f78-294705cd1e21 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:31.772412 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5688748-c162-4c6d-bf8d-3ca309d2e7f0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:31.819421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 176/360] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:31.820904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459be18-8745-4734-8c3e-3901c1ce6993 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:31.821301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459be18-8745-4734-8c3e-3901c1ce6993 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:31.821616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459be18-8745-4734-8c3e-3901c1ce6993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:31.823575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891ce8d-283b-4e00-9312-1d19e47b59e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:31.824484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ce8d-283b-4e00-9312-1d19e47b59e0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:31.824774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ce8d-283b-4e00-9312-1d19e47b59e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:31.825047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ce8d-283b-4e00-9312-1d19e47b59e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:31.826468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891ce8d-283b-4e00-9312-1d19e47b59e0 None admin] RBAC: Adding query filter params (role.id=2151a047bd9744e5be942a6bbd8c0f28, user.id=e2b6e0eeb26c4576b163be3fb93cdff0, scope.system=all) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:31.826468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891ce8d-283b-4e00-9312-1d19e47b59e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:31.829911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891ce8d-283b-4e00-9312-1d19e47b59e0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:31.844338 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 185/361] 10.222.0.26 () {56 vars in 1308 bytes} [Mon Feb 28 21:35:31 2022] GET /identity/v3/role_assignments?user.id=e2b6e0eeb26c4576b163be3fb93cdff0&scope.system=all&role.id=2151a047bd9744e5be942a6bbd8c0f28 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:31.846225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881cd2-b447-43fc-ba79-4f0a927d5e45 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:31.846710 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881cd2-b447-43fc-ba79-4f0a927d5e45 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:31.846812 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-4459be18-8745-4734-8c3e-3901c1ce6993 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:31.847288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881cd2-b447-43fc-ba79-4f0a927d5e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:31.847951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4459be18-8745-4734-8c3e-3901c1ce6993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:31.875997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ad881cd2-b447-43fc-ba79-4f0a927d5e45 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:31.877232 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ad881cd2-b447-43fc-ba79-4f0a927d5e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:31.942112 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 177/362] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:31.943123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459be18-8745-4734-8c3e-3901c1ce6993 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:31.962518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 186/363] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:31.964636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad881cd2-b447-43fc-ba79-4f0a927d5e45 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:32.081180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459be18-8745-4734-8c3e-3901c1ce6993 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.107707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad881cd2-b447-43fc-ba79-4f0a927d5e45 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.121057 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc20ac-e962-4fc6-8516-4c3ef2c129de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:32.121923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc20ac-e962-4fc6-8516-4c3ef2c129de None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:32.122294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc20ac-e962-4fc6-8516-4c3ef2c129de None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:32.122567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc20ac-e962-4fc6-8516-4c3ef2c129de None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:32.123819 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc20ac-e962-4fc6-8516-4c3ef2c129de None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:32.125261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc20ac-e962-4fc6-8516-4c3ef2c129de None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:32.126922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 178/364] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:31 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:32.127737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc20ac-e962-4fc6-8516-4c3ef2c129de None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:32.148971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3819b-7558-4696-a470-229cb0d3efe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:32.149943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3819b-7558-4696-a470-229cb0d3efe9 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:32.150313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3819b-7558-4696-a470-229cb0d3efe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:32.150588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3819b-7558-4696-a470-229cb0d3efe9 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:32.151858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3819b-7558-4696-a470-229cb0d3efe9 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:32.153300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3819b-7558-4696-a470-229cb0d3efe9 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:32.155046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 187/365] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:31 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:32.155807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3819b-7558-4696-a470-229cb0d3efe9 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:32.232237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc20ac-e962-4fc6-8516-4c3ef2c129de None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.267954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed70f4-68c2-42fc-9aaf-7a1e78f4a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:32.268772 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed70f4-68c2-42fc-9aaf-7a1e78f4a384 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:32.269044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed70f4-68c2-42fc-9aaf-7a1e78f4a384 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:32.269310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed70f4-68c2-42fc-9aaf-7a1e78f4a384 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:32.270444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3819b-7558-4696-a470-229cb0d3efe9 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.280200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed70f4-68c2-42fc-9aaf-7a1e78f4a384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:32.287655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-07ed70f4-68c2-42fc-9aaf-7a1e78f4a384 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:32.288893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 179/366] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:32.290249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed70f4-68c2-42fc-9aaf-7a1e78f4a384 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:32.318959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf67d-0efb-4332-a138-8feb6c1a1ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:32.319754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf67d-0efb-4332-a138-8feb6c1a1ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:32.320034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf67d-0efb-4332-a138-8feb6c1a1ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:32.320306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf67d-0efb-4332-a138-8feb6c1a1ba4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:32.331806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edf67d-0efb-4332-a138-8feb6c1a1ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:32.339184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-e1edf67d-0efb-4332-a138-8feb6c1a1ba4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:35:32.340704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 188/367] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:35:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:32.341492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf67d-0efb-4332-a138-8feb6c1a1ba4 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:32.422385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed70f4-68c2-42fc-9aaf-7a1e78f4a384 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.466844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf67d-0efb-4332-a138-8feb6c1a1ba4 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.468306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c75d4-8ad0-49fa-8518-9f5bdeb036bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:32.468857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c75d4-8ad0-49fa-8518-9f5bdeb036bb None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:32.469138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c75d4-8ad0-49fa-8518-9f5bdeb036bb None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:32.469410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c75d4-8ad0-49fa-8518-9f5bdeb036bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:32.470282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c75d4-8ad0-49fa-8518-9f5bdeb036bb None admin] RBAC: Adding query filter params (group.id=e37010764bde43a7aaf0ac545da4757d, role.id=b15932e4d63b437eb478fd41d0ae6ec6, scope.project.id=aae7a29125d84943bd6b641569d01895) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:32.470589 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c75d4-8ad0-49fa-8518-9f5bdeb036bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:32.472061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c75d4-8ad0-49fa-8518-9f5bdeb036bb None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:32.480881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 180/368] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Feb 28 21:35:32 2022] GET /identity/v3/role_assignments?group.id=e37010764bde43a7aaf0ac545da4757d&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:32.482479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c75d4-8ad0-49fa-8518-9f5bdeb036bb None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:32.508699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cdbce-e184-4409-bd0e-a955bc4e2160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:32.509580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cdbce-e184-4409-bd0e-a955bc4e2160 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:32.510120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cdbce-e184-4409-bd0e-a955bc4e2160 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:32.510414 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cdbce-e184-4409-bd0e-a955bc4e2160 None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:32.511744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cdbce-e184-4409-bd0e-a955bc4e2160 None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:32.513285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cdbce-e184-4409-bd0e-a955bc4e2160 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:32.516212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 189/369] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:32 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:32.516883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cdbce-e184-4409-bd0e-a955bc4e2160 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:32.625079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c75d4-8ad0-49fa-8518-9f5bdeb036bb None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.648982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cdbce-e184-4409-bd0e-a955bc4e2160 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.668693 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15634bc-7532-44f1-981f-3fade290f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:32.670229 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15634bc-7532-44f1-981f-3fade290f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:32.670720 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15634bc-7532-44f1-981f-3fade290f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:32.671215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15634bc-7532-44f1-981f-3fade290f5d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:32.672194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15634bc-7532-44f1-981f-3fade290f5d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:32.673122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15634bc-7532-44f1-981f-3fade290f5d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:32.674923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15634bc-7532-44f1-981f-3fade290f5d0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:32.688062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 181/370] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:32.689269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15634bc-7532-44f1-981f-3fade290f5d0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:32.693652 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fc0d0-c8db-4027-9a46-9a371bbeeff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:32.693652 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fc0d0-c8db-4027-9a46-9a371bbeeff3 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:32.693953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fc0d0-c8db-4027-9a46-9a371bbeeff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:32.694384 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fc0d0-c8db-4027-9a46-9a371bbeeff3 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:32.695220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fc0d0-c8db-4027-9a46-9a371bbeeff3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:32.696556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fc0d0-c8db-4027-9a46-9a371bbeeff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:32.698251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fc0d0-c8db-4027-9a46-9a371bbeeff3 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:32.713958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 190/371] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:32.715364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fc0d0-c8db-4027-9a46-9a371bbeeff3 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:32.800992 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15634bc-7532-44f1-981f-3fade290f5d0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.838481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12456c5-0ddd-4e31-b827-78249c7c080c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:32.839174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12456c5-0ddd-4e31-b827-78249c7c080c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:32.839425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12456c5-0ddd-4e31-b827-78249c7c080c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:32.839692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12456c5-0ddd-4e31-b827-78249c7c080c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:32.840523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12456c5-0ddd-4e31-b827-78249c7c080c None admin] RBAC: Adding query filter params (group.id=e37010764bde43a7aaf0ac545da4757d, role.id=b15932e4d63b437eb478fd41d0ae6ec6, scope.project.id=7b3f655528294e62a0a33ce69e504013) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:32.840828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12456c5-0ddd-4e31-b827-78249c7c080c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:32.843515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12456c5-0ddd-4e31-b827-78249c7c080c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:32.844280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fc0d0-c8db-4027-9a46-9a371bbeeff3 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.849552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 182/372] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Feb 28 21:35:32 2022] GET /identity/v3/role_assignments?group.id=e37010764bde43a7aaf0ac545da4757d&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:32.850827 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12456c5-0ddd-4e31-b827-78249c7c080c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:32.890724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167d94a-93fe-4d6d-bab5-cd1d7eb90f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:32.891431 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167d94a-93fe-4d6d-bab5-cd1d7eb90f66 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:32.891793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167d94a-93fe-4d6d-bab5-cd1d7eb90f66 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:32.892086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167d94a-93fe-4d6d-bab5-cd1d7eb90f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:32.970769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12456c5-0ddd-4e31-b827-78249c7c080c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:32.986254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167d94a-93fe-4d6d-bab5-cd1d7eb90f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:32.988092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167d94a-93fe-4d6d-bab5-cd1d7eb90f66 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:33.014928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d340154-f325-4b63-bfe6-b25ae722f823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:33.015947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d340154-f325-4b63-bfe6-b25ae722f823 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:33.016735 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d340154-f325-4b63-bfe6-b25ae722f823 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:33.017240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d340154-f325-4b63-bfe6-b25ae722f823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:33.152992 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d340154-f325-4b63-bfe6-b25ae722f823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:33.156938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d340154-f325-4b63-bfe6-b25ae722f823 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:33.175796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 191/373] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:33.184745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167d94a-93fe-4d6d-bab5-cd1d7eb90f66 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:33.269771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 183/374] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:33.281702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d340154-f325-4b63-bfe6-b25ae722f823 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:33.290317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167d94a-93fe-4d6d-bab5-cd1d7eb90f66 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:33.332403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113a93-b109-4ddc-ae03-213312524067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:33.333636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113a93-b109-4ddc-ae03-213312524067 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:33.334325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113a93-b109-4ddc-ae03-213312524067 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:33.337379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113a93-b109-4ddc-ae03-213312524067 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:33.339651 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7113a93-b109-4ddc-ae03-213312524067 None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:33.341310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7113a93-b109-4ddc-ae03-213312524067 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:33.347921 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 192/375] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:33 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:33.353737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113a93-b109-4ddc-ae03-213312524067 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:33.460072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d340154-f325-4b63-bfe6-b25ae722f823 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:33.531897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b5e72-cb82-4886-94c3-f80989e6225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:33.533737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5e72-cb82-4886-94c3-f80989e6225b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:33.534253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5e72-cb82-4886-94c3-f80989e6225b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:33.534742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5e72-cb82-4886-94c3-f80989e6225b None admin] PATH_INFO: `/v3/projects/7297e55969ab4bf0b026f4e20d2cae80` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:33.536185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b5e72-cb82-4886-94c3-f80989e6225b None admin] RBAC: Authorizing `identity:get_project(project_id=7297e55969ab4bf0b026f4e20d2cae80)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:33.537829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b5e72-cb82-4886-94c3-f80989e6225b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:33.540444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113a93-b109-4ddc-ae03-213312524067 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:33.540830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 184/376] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:33 2022] GET /identity/v3/projects/7297e55969ab4bf0b026f4e20d2cae80 => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:33.546920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b5e72-cb82-4886-94c3-f80989e6225b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:33.591538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2854c7b-8685-47d1-81ac-1ae001da360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:33.592481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2854c7b-8685-47d1-81ac-1ae001da360a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:33.592755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2854c7b-8685-47d1-81ac-1ae001da360a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:33.593025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2854c7b-8685-47d1-81ac-1ae001da360a None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:33.597840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2854c7b-8685-47d1-81ac-1ae001da360a None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:33.599436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2854c7b-8685-47d1-81ac-1ae001da360a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:33.601140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 193/377] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:33 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:33.607034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2854c7b-8685-47d1-81ac-1ae001da360a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:33.747168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2854c7b-8685-47d1-81ac-1ae001da360a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:33.794039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492a890-9344-4459-8381-07e31f6799a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:33.794978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492a890-9344-4459-8381-07e31f6799a0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:33.795252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492a890-9344-4459-8381-07e31f6799a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:33.795521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492a890-9344-4459-8381-07e31f6799a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:33.796897 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492a890-9344-4459-8381-07e31f6799a0 None admin] RBAC: Adding query filter params (group.id=e37010764bde43a7aaf0ac545da4757d, role.id=e83d49af62db4f4aa2dcadb10a82bfdc, scope.project.id=aae7a29125d84943bd6b641569d01895) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:33.797204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492a890-9344-4459-8381-07e31f6799a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:33.798942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3492a890-9344-4459-8381-07e31f6799a0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:33.805106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 194/378] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Feb 28 21:35:33 2022] GET /identity/v3/role_assignments?group.id=e37010764bde43a7aaf0ac545da4757d&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=e83d49af62db4f4aa2dcadb10a82bfdc => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:33.807719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b5e72-cb82-4886-94c3-f80989e6225b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:33.882828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9448a01-870b-436d-b214-89e70486419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:33.883822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448a01-870b-436d-b214-89e70486419b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:33.884107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448a01-870b-436d-b214-89e70486419b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:33.884373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448a01-870b-436d-b214-89e70486419b None admin] PATH_INFO: `/v3/groups/242f26cc0acd4938a84a835c867ecd5f` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:33.891838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9448a01-870b-436d-b214-89e70486419b None admin] RBAC: Authorizing `identity:get_group(group_id=242f26cc0acd4938a84a835c867ecd5f)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:33.893310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9448a01-870b-436d-b214-89e70486419b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:33.895411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 185/379] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:33 2022] GET /identity/v3/groups/242f26cc0acd4938a84a835c867ecd5f => generated 229 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:33.901695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492a890-9344-4459-8381-07e31f6799a0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:34.017480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492a890-9344-4459-8381-07e31f6799a0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:34.058088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4050b38-b848-47a0-a80f-c286698d7b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:34.058741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4050b38-b848-47a0-a80f-c286698d7b7f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:34.059016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4050b38-b848-47a0-a80f-c286698d7b7f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:34.059283 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4050b38-b848-47a0-a80f-c286698d7b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:34.060103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4050b38-b848-47a0-a80f-c286698d7b7f None admin] RBAC: Adding query filter params (group.id=242f26cc0acd4938a84a835c867ecd5f, role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=7297e55969ab4bf0b026f4e20d2cae80) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:34.060403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4050b38-b848-47a0-a80f-c286698d7b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:34.061815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4050b38-b848-47a0-a80f-c286698d7b7f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:34.067787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 195/380] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Feb 28 21:35:33 2022] GET /identity/v3/role_assignments?group.id=242f26cc0acd4938a84a835c867ecd5f&scope.project.id=7297e55969ab4bf0b026f4e20d2cae80&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:34.075094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafc39f-6447-430d-8ddd-bc91ab139113 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:34.075393 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafc39f-6447-430d-8ddd-bc91ab139113 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:34.075647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafc39f-6447-430d-8ddd-bc91ab139113 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:34.077859 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 186/381] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:34.083810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1263-2d7a-4516-924f-0060f68a1c5e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:34.084121 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1263-2d7a-4516-924f-0060f68a1c5e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:34.084348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c1263-2d7a-4516-924f-0060f68a1c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:34.103453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-278c1263-2d7a-4516-924f-0060f68a1c5e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:34.104665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-278c1263-2d7a-4516-924f-0060f68a1c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:34.192943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 196/382] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:34.216762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafc39f-6447-430d-8ddd-bc91ab139113 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:34.332032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafc39f-6447-430d-8ddd-bc91ab139113 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:34.365952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6f45c-700a-4d85-92bc-d4aad4b30f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:34.366790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6f45c-700a-4d85-92bc-d4aad4b30f5b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:34.367067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6f45c-700a-4d85-92bc-d4aad4b30f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:34.367336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6f45c-700a-4d85-92bc-d4aad4b30f5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:34.378468 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6f45c-700a-4d85-92bc-d4aad4b30f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:34.387020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-57c6f45c-700a-4d85-92bc-d4aad4b30f5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:34.388560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 187/383] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:34.394034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c1263-2d7a-4516-924f-0060f68a1c5e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:34.494777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c1263-2d7a-4516-924f-0060f68a1c5e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:34.530556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8764ea-0bfa-4a89-ba3f-5886ff137f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:34.531232 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8764ea-0bfa-4a89-ba3f-5886ff137f64 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:34.531503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8764ea-0bfa-4a89-ba3f-5886ff137f64 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:34.531767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8764ea-0bfa-4a89-ba3f-5886ff137f64 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:34.532517 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8764ea-0bfa-4a89-ba3f-5886ff137f64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:34.532869 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8764ea-0bfa-4a89-ba3f-5886ff137f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:34.534243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8764ea-0bfa-4a89-ba3f-5886ff137f64 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:34.546454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 197/384] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:34.555245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6f45c-700a-4d85-92bc-d4aad4b30f5b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:34.660703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6f45c-700a-4d85-92bc-d4aad4b30f5b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:34.694523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257778a-f1c7-4c52-a39e-e1fec2af6ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:34.695372 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257778a-f1c7-4c52-a39e-e1fec2af6ad5 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:34.695712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257778a-f1c7-4c52-a39e-e1fec2af6ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:34.696058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257778a-f1c7-4c52-a39e-e1fec2af6ad5 None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:34.697139 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257778a-f1c7-4c52-a39e-e1fec2af6ad5 None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:34.698626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257778a-f1c7-4c52-a39e-e1fec2af6ad5 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:34.704602 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 188/385] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:34 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:34.705941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8764ea-0bfa-4a89-ba3f-5886ff137f64 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:34.834906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8764ea-0bfa-4a89-ba3f-5886ff137f64 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:34.887249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061ddae-8079-4679-b41b-e08578a59be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:34.888123 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061ddae-8079-4679-b41b-e08578a59be9 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:34.888398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061ddae-8079-4679-b41b-e08578a59be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:34.888669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061ddae-8079-4679-b41b-e08578a59be9 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:34.889870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061ddae-8079-4679-b41b-e08578a59be9 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:34.891320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061ddae-8079-4679-b41b-e08578a59be9 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:34.892993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 198/386] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:34 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:34.898885 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257778a-f1c7-4c52-a39e-e1fec2af6ad5 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:35.032913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257778a-f1c7-4c52-a39e-e1fec2af6ad5 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:35.079875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898601f4-01b6-45bc-864c-06b41d37fe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:35.080772 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898601f4-01b6-45bc-864c-06b41d37fe68 None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:35.081043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898601f4-01b6-45bc-864c-06b41d37fe68 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:35.081316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898601f4-01b6-45bc-864c-06b41d37fe68 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013/groups/e37010764bde43a7aaf0ac545da4757d/roles/e83d49af62db4f4aa2dcadb10a82bfdc` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:35.088624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898601f4-01b6-45bc-864c-06b41d37fe68 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b3f655528294e62a0a33ce69e504013, group_id=e37010764bde43a7aaf0ac545da4757d, role_id=e83d49af62db4f4aa2dcadb10a82bfdc)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:35.090096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898601f4-01b6-45bc-864c-06b41d37fe68 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:35.112886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73fc2-9da9-4203-8358-1b28f53f100a None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:35.113166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73fc2-9da9-4203-8358-1b28f53f100a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:35.116623 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f73fc2-9da9-4203-8358-1b28f53f100a None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:35.116623 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 199/387] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:35.120871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d873-2a68-46e2-bd0d-1e37a7024aec None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:35.121155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d873-2a68-46e2-bd0d-1e37a7024aec None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:35.121431 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4d873-2a68-46e2-bd0d-1e37a7024aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:35.139469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2aa4d873-2a68-46e2-bd0d-1e37a7024aec None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:35.143981 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2aa4d873-2a68-46e2-bd0d-1e37a7024aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:35.174733 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 189/388] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Feb 28 21:35:34 2022] PUT /identity/v3/projects/7b3f655528294e62a0a33ce69e504013/groups/e37010764bde43a7aaf0ac545da4757d/roles/e83d49af62db4f4aa2dcadb10a82bfdc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:35.229509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 200/389] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:35.255440 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898601f4-01b6-45bc-864c-06b41d37fe68 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:35.363204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898601f4-01b6-45bc-864c-06b41d37fe68 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:35.401663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f1f4a-b4e6-493a-8bf5-e1b9d8fead86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:35.402874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f1f4a-b4e6-493a-8bf5-e1b9d8fead86 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:35.403350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f1f4a-b4e6-493a-8bf5-e1b9d8fead86 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:35.403816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f1f4a-b4e6-493a-8bf5-e1b9d8fead86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:35.414976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f1f4a-b4e6-493a-8bf5-e1b9d8fead86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:35.423024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-d16f1f4a-b4e6-493a-8bf5-e1b9d8fead86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:35.429101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 190/390] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:35.431705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4d873-2a68-46e2-bd0d-1e37a7024aec None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:35.538903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4d873-2a68-46e2-bd0d-1e37a7024aec None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:35.576582 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fcdc9-7f79-43f6-916b-abd8b50eeaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:35.577257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fcdc9-7f79-43f6-916b-abd8b50eeaaf None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:35.577536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fcdc9-7f79-43f6-916b-abd8b50eeaaf None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:35.577808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fcdc9-7f79-43f6-916b-abd8b50eeaaf None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:35.578583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fcdc9-7f79-43f6-916b-abd8b50eeaaf None admin] RBAC: Adding query filter params (name=member) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:35.578886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fcdc9-7f79-43f6-916b-abd8b50eeaaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:35.580253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fcdc9-7f79-43f6-916b-abd8b50eeaaf None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:35.589284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 201/391] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:35.594762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f1f4a-b4e6-493a-8bf5-e1b9d8fead86 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:35.705705 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f1f4a-b4e6-493a-8bf5-e1b9d8fead86 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:35.749953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d4b96-e1a0-46e0-88bc-ec52f5fb6b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:35.750875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d4b96-e1a0-46e0-88bc-ec52f5fb6b87 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:35.751156 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d4b96-e1a0-46e0-88bc-ec52f5fb6b87 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:35.751432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d4b96-e1a0-46e0-88bc-ec52f5fb6b87 None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:35.752710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d4b96-e1a0-46e0-88bc-ec52f5fb6b87 None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:35.754230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d4b96-e1a0-46e0-88bc-ec52f5fb6b87 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:35.756195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 191/392] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:35 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:35.762262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fcdc9-7f79-43f6-916b-abd8b50eeaaf None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:35.881726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fcdc9-7f79-43f6-916b-abd8b50eeaaf None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:35.927731 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaf255-e2cd-4c8d-aee0-657764eeaa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:35.928609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf255-e2cd-4c8d-aee0-657764eeaa4e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:35.928889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf255-e2cd-4c8d-aee0-657764eeaa4e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:35.929162 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf255-e2cd-4c8d-aee0-657764eeaa4e None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:35.930745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaf255-e2cd-4c8d-aee0-657764eeaa4e None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:35.932177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaf255-e2cd-4c8d-aee0-657764eeaa4e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:35.934183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 202/393] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:35 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:35.939450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d4b96-e1a0-46e0-88bc-ec52f5fb6b87 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:36.073201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d4b96-e1a0-46e0-88bc-ec52f5fb6b87 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:36.114455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd485fa-3b57-42c3-b14a-08ed864bd7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:36.115572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd485fa-3b57-42c3-b14a-08ed864bd7a3 None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:36.116016 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd485fa-3b57-42c3-b14a-08ed864bd7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:36.116427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd485fa-3b57-42c3-b14a-08ed864bd7a3 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895/groups/e37010764bde43a7aaf0ac545da4757d/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:36.118839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4552c-5da0-4ccc-838f-a5df4c9bd699 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:36.119125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4552c-5da0-4ccc-838f-a5df4c9bd699 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:36.119338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd485fa-3b57-42c3-b14a-08ed864bd7a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=aae7a29125d84943bd6b641569d01895, group_id=e37010764bde43a7aaf0ac545da4757d, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:36.119464 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4552c-5da0-4ccc-838f-a5df4c9bd699 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:36.121080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd485fa-3b57-42c3-b14a-08ed864bd7a3 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:36.121195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 203/394] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:36.127890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3321-ee22-4d96-ac1f-c053df1e1c46 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:36.127890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3321-ee22-4d96-ac1f-c053df1e1c46 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:36.127890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3321-ee22-4d96-ac1f-c053df1e1c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:36.144555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0e9b3321-ee22-4d96-ac1f-c053df1e1c46 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:36.145896 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0e9b3321-ee22-4d96-ac1f-c053df1e1c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:36.213206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 204/395] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:36.229311 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 192/396] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Feb 28 21:35:35 2022] PUT /identity/v3/projects/aae7a29125d84943bd6b641569d01895/groups/e37010764bde43a7aaf0ac545da4757d/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:36.238596 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3321-ee22-4d96-ac1f-c053df1e1c46 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:36.362752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3321-ee22-4d96-ac1f-c053df1e1c46 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:36.412906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d3830-4ecf-4501-b8af-a9bd7df3d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:36.413722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d3830-4ecf-4501-b8af-a9bd7df3d213 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:36.414013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d3830-4ecf-4501-b8af-a9bd7df3d213 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:36.414463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d3830-4ecf-4501-b8af-a9bd7df3d213 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:36.427863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d3830-4ecf-4501-b8af-a9bd7df3d213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:36.435603 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-4d0d3830-4ecf-4501-b8af-a9bd7df3d213 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:36.436816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 205/397] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:36.442551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd485fa-3b57-42c3-b14a-08ed864bd7a3 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:36.603495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd485fa-3b57-42c3-b14a-08ed864bd7a3 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:36.640991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ed4ec-638e-4a3c-8a2b-e7ae2e2dbff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:36.641631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed4ec-638e-4a3c-8a2b-e7ae2e2dbff9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:36.641909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed4ec-638e-4a3c-8a2b-e7ae2e2dbff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:36.642200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed4ec-638e-4a3c-8a2b-e7ae2e2dbff9 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:36.643086 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ed4ec-638e-4a3c-8a2b-e7ae2e2dbff9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:36.643431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ed4ec-638e-4a3c-8a2b-e7ae2e2dbff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:36.644797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ed4ec-638e-4a3c-8a2b-e7ae2e2dbff9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:36.653581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 193/398] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:36.659132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d3830-4ecf-4501-b8af-a9bd7df3d213 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:36.801614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d3830-4ecf-4501-b8af-a9bd7df3d213 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:36.844562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706446a-0a89-4faa-9a26-278f26fe7ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:36.845531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706446a-0a89-4faa-9a26-278f26fe7ef5 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:36.845815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706446a-0a89-4faa-9a26-278f26fe7ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:36.846112 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706446a-0a89-4faa-9a26-278f26fe7ef5 None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:36.850533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706446a-0a89-4faa-9a26-278f26fe7ef5 None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:36.852643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706446a-0a89-4faa-9a26-278f26fe7ef5 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:36.854708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 206/399] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:36 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:36.860152 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ed4ec-638e-4a3c-8a2b-e7ae2e2dbff9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:36.939308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a0538-3f2d-4b11-9424-7056c805cb52 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:36.939926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a0538-3f2d-4b11-9424-7056c805cb52 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:36.940655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a0538-3f2d-4b11-9424-7056c805cb52 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:36.943152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 207/400] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:36.949368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c3be-e462-46c4-bb32-14fddf4db84d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:36.950012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c3be-e462-46c4-bb32-14fddf4db84d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:36.950532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c3be-e462-46c4-bb32-14fddf4db84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:36.983064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e592c3be-e462-46c4-bb32-14fddf4db84d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:36.986023 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e592c3be-e462-46c4-bb32-14fddf4db84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:37.011460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ed4ec-638e-4a3c-8a2b-e7ae2e2dbff9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:37.071819 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c788ea8-44fc-4eb5-acd3-f35d54fe8a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:37.072966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c788ea8-44fc-4eb5-acd3-f35d54fe8a29 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:37.073382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c788ea8-44fc-4eb5-acd3-f35d54fe8a29 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:37.073780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c788ea8-44fc-4eb5-acd3-f35d54fe8a29 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:37.075872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c788ea8-44fc-4eb5-acd3-f35d54fe8a29 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:37.078156 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c788ea8-44fc-4eb5-acd3-f35d54fe8a29 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:37.080688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 194/401] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:36 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:37.086879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322b10-8b53-4719-85cf-273b0905bb06 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:37.086879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322b10-8b53-4719-85cf-273b0905bb06 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:37.086879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322b10-8b53-4719-85cf-273b0905bb06 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:37.086879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 195/402] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:37.090413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e322b10-8b53-4719-85cf-273b0905bb06 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:37.104251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 208/403] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:37.106040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ce2f-ef3f-433c-9d02-deb97692e49e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:37.106361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ce2f-ef3f-433c-9d02-deb97692e49e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:37.106638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ce2f-ef3f-433c-9d02-deb97692e49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:37.129216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2d74ce2f-ef3f-433c-9d02-deb97692e49e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:37.130470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2d74ce2f-ef3f-433c-9d02-deb97692e49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:37.207768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 209/404] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:37.208875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74ce2f-ef3f-433c-9d02-deb97692e49e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:37.209253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e322b10-8b53-4719-85cf-273b0905bb06 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:37.247760 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a74759-ec20-4b78-84a4-84e5f596974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:37.249630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a74759-ec20-4b78-84a4-84e5f596974b None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:37.250210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a74759-ec20-4b78-84a4-84e5f596974b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:37.250645 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a74759-ec20-4b78-84a4-84e5f596974b None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013/groups/e37010764bde43a7aaf0ac545da4757d/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:37.252779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a74759-ec20-4b78-84a4-84e5f596974b None admin] RBAC: Authorizing `identity:create_grant(project_id=7b3f655528294e62a0a33ce69e504013, group_id=e37010764bde43a7aaf0ac545da4757d, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:37.254824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a74759-ec20-4b78-84a4-84e5f596974b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:37.312961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74ce2f-ef3f-433c-9d02-deb97692e49e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:37.329313 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 196/405] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Feb 28 21:35:37 2022] PUT /identity/v3/projects/7b3f655528294e62a0a33ce69e504013/groups/e37010764bde43a7aaf0ac545da4757d/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:37.330191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a74759-ec20-4b78-84a4-84e5f596974b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:37.391739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa862-678e-42db-9e40-ce1d60378d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:37.392548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa862-678e-42db-9e40-ce1d60378d88 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:37.392825 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa862-678e-42db-9e40-ce1d60378d88 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:37.393097 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa862-678e-42db-9e40-ce1d60378d88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:37.423288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa862-678e-42db-9e40-ce1d60378d88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:37.438512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-56efa862-678e-42db-9e40-ce1d60378d88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:35:37.440039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 210/406] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:37.446615 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa862-678e-42db-9e40-ce1d60378d88 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:37.453039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a74759-ec20-4b78-84a4-84e5f596974b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:37.493149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ebcd5-9586-439b-afaa-95dd034fb20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:37.494051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ebcd5-9586-439b-afaa-95dd034fb20a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:37.494341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ebcd5-9586-439b-afaa-95dd034fb20a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:37.494617 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ebcd5-9586-439b-afaa-95dd034fb20a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:37.507403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ebcd5-9586-439b-afaa-95dd034fb20a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:37.516498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-295ebcd5-9586-439b-afaa-95dd034fb20a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:37.518174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 197/407] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:37.523968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ebcd5-9586-439b-afaa-95dd034fb20a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:37.646136 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa862-678e-42db-9e40-ce1d60378d88 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:37.669045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ebcd5-9586-439b-afaa-95dd034fb20a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:37.702193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605965b-7229-4c71-92fa-e955bb03e6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:37.703135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605965b-7229-4c71-92fa-e955bb03e6f8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:37.703557 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605965b-7229-4c71-92fa-e955bb03e6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:37.703965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605965b-7229-4c71-92fa-e955bb03e6f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:37.704846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605965b-7229-4c71-92fa-e955bb03e6f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:37.705299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605965b-7229-4c71-92fa-e955bb03e6f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:37.706827 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605965b-7229-4c71-92fa-e955bb03e6f8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:37.720591 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 211/408] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:37.726934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605965b-7229-4c71-92fa-e955bb03e6f8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:37.735577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c364-74ac-4aea-bc06-7559bbda22e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:37.736262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c364-74ac-4aea-bc06-7559bbda22e2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:37.736543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c364-74ac-4aea-bc06-7559bbda22e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:37.736872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c364-74ac-4aea-bc06-7559bbda22e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:37.737636 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641c364-74ac-4aea-bc06-7559bbda22e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:37.737938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641c364-74ac-4aea-bc06-7559bbda22e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:37.739381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641c364-74ac-4aea-bc06-7559bbda22e2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:37.757577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 198/409] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:37.762789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c364-74ac-4aea-bc06-7559bbda22e2 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:37.849829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605965b-7229-4c71-92fa-e955bb03e6f8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:37.894244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10b26c-f877-4c90-acfa-60c4840be5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:37.895418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b26c-f877-4c90-acfa-60c4840be5be None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:37.895702 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b26c-f877-4c90-acfa-60c4840be5be None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:37.895977 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10b26c-f877-4c90-acfa-60c4840be5be None admin] PATH_INFO: `/v3/groups/242f26cc0acd4938a84a835c867ecd5f` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:37.897257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10b26c-f877-4c90-acfa-60c4840be5be None admin] RBAC: Authorizing `identity:get_group(group_id=242f26cc0acd4938a84a835c867ecd5f)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:37.899519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10b26c-f877-4c90-acfa-60c4840be5be None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:37.901784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 212/410] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:37 2022] GET /identity/v3/groups/242f26cc0acd4938a84a835c867ecd5f => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:37.907489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10b26c-f877-4c90-acfa-60c4840be5be None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:38.003851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c364-74ac-4aea-bc06-7559bbda22e2 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:38.047487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10b26c-f877-4c90-acfa-60c4840be5be None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:38.049415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb6e32-3592-406e-90e9-aa0b6e4e0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:38.050259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb6e32-3592-406e-90e9-aa0b6e4e0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:38.051211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb6e32-3592-406e-90e9-aa0b6e4e0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:38.051211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb6e32-3592-406e-90e9-aa0b6e4e0eb9 None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:38.051966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb6e32-3592-406e-90e9-aa0b6e4e0eb9 None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:38.053403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb6e32-3592-406e-90e9-aa0b6e4e0eb9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:38.060171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 199/411] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:37 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:38.066935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb6e32-3592-406e-90e9-aa0b6e4e0eb9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:38.092731 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7497ee-e29d-4a20-9010-881ae4ea4e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:38.093961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7497ee-e29d-4a20-9010-881ae4ea4e70 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:38.094572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7497ee-e29d-4a20-9010-881ae4ea4e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:38.095788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7497ee-e29d-4a20-9010-881ae4ea4e70 None admin] PATH_INFO: `/v3/projects/7297e55969ab4bf0b026f4e20d2cae80` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:38.099272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7497ee-e29d-4a20-9010-881ae4ea4e70 None admin] RBAC: Authorizing `identity:get_project(project_id=7297e55969ab4bf0b026f4e20d2cae80)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:38.100922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7497ee-e29d-4a20-9010-881ae4ea4e70 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:38.104327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 213/412] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:37 2022] GET /identity/v3/projects/7297e55969ab4bf0b026f4e20d2cae80 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:38.109857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7497ee-e29d-4a20-9010-881ae4ea4e70 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:38.230666 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb6e32-3592-406e-90e9-aa0b6e4e0eb9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:38.266746 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352d6a3-c8a8-48d1-9d16-9b92565f17bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:38.268471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352d6a3-c8a8-48d1-9d16-9b92565f17bb None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:38.268935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352d6a3-c8a8-48d1-9d16-9b92565f17bb None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:38.269422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352d6a3-c8a8-48d1-9d16-9b92565f17bb None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:38.269909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7497ee-e29d-4a20-9010-881ae4ea4e70 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:38.271027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352d6a3-c8a8-48d1-9d16-9b92565f17bb None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:38.274219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352d6a3-c8a8-48d1-9d16-9b92565f17bb None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:38.276518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 200/413] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:38 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:38.278475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bff0d-4cd2-476b-af94-3965aae16117 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:38.278944 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bff0d-4cd2-476b-af94-3965aae16117 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:38.279394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bff0d-4cd2-476b-af94-3965aae16117 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:38.281369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 201/414] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:38.282276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bff0d-4cd2-476b-af94-3965aae16117 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:38.313950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f86f1a-408a-46aa-9624-20d6f692b232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:38.314900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f86f1a-408a-46aa-9624-20d6f692b232 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:38.315340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f86f1a-408a-46aa-9624-20d6f692b232 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:38.315619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f86f1a-408a-46aa-9624-20d6f692b232 None admin] PATH_INFO: `/v3/projects/7297e55969ab4bf0b026f4e20d2cae80/groups/242f26cc0acd4938a84a835c867ecd5f/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:38.318397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f86f1a-408a-46aa-9624-20d6f692b232 None admin] RBAC: Authorizing `identity:create_grant(project_id=7297e55969ab4bf0b026f4e20d2cae80, group_id=242f26cc0acd4938a84a835c867ecd5f, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:38.320473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f86f1a-408a-46aa-9624-20d6f692b232 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:38.392608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bff0d-4cd2-476b-af94-3965aae16117 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:38.393258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 214/415] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Feb 28 21:35:38 2022] PUT /identity/v3/projects/7297e55969ab4bf0b026f4e20d2cae80/groups/242f26cc0acd4938a84a835c867ecd5f/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:35:38.394922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca1c1-2f80-4f38-8f7e-ce1745b87196 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:38.395218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca1c1-2f80-4f38-8f7e-ce1745b87196 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:38.395579 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cca1c1-2f80-4f38-8f7e-ce1745b87196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:38.436925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d9cca1c1-2f80-4f38-8f7e-ce1745b87196 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:38.438192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d9cca1c1-2f80-4f38-8f7e-ce1745b87196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:38.479664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61783f21-30ec-47ea-8ddc-59265ea42f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:38.480625 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783f21-30ec-47ea-8ddc-59265ea42f09 None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:38.480975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783f21-30ec-47ea-8ddc-59265ea42f09 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:38.481252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783f21-30ec-47ea-8ddc-59265ea42f09 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895/groups/e37010764bde43a7aaf0ac545da4757d/roles/e83d49af62db4f4aa2dcadb10a82bfdc` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:38.487751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61783f21-30ec-47ea-8ddc-59265ea42f09 None admin] RBAC: Authorizing `identity:create_grant(project_id=aae7a29125d84943bd6b641569d01895, group_id=e37010764bde43a7aaf0ac545da4757d, role_id=e83d49af62db4f4aa2dcadb10a82bfdc)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:38.490259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61783f21-30ec-47ea-8ddc-59265ea42f09 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:38.550386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 215/416] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:38.570163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 202/417] 10.222.0.26 () {58 vars in 1442 bytes} [Mon Feb 28 21:35:38 2022] PUT /identity/v3/projects/aae7a29125d84943bd6b641569d01895/groups/e37010764bde43a7aaf0ac545da4757d/roles/e83d49af62db4f4aa2dcadb10a82bfdc => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:38.574828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca1c1-2f80-4f38-8f7e-ce1745b87196 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:38.691426 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cca1c1-2f80-4f38-8f7e-ce1745b87196 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:38.732799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635df27-9931-438f-aac7-5e074ff5dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:38.733637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635df27-9931-438f-aac7-5e074ff5dae8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:38.733916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635df27-9931-438f-aac7-5e074ff5dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:38.734234 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635df27-9931-438f-aac7-5e074ff5dae8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:38.748649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635df27-9931-438f-aac7-5e074ff5dae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:38.756500 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-8635df27-9931-438f-aac7-5e074ff5dae8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:38.758155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 216/418] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:38.764293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61783f21-30ec-47ea-8ddc-59265ea42f09 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:38.877800 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61783f21-30ec-47ea-8ddc-59265ea42f09 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:38.912860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aef63-8657-4848-a68b-c4c63f5b3d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:38.913530 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aef63-8657-4848-a68b-c4c63f5b3d52 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:38.913843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aef63-8657-4848-a68b-c4c63f5b3d52 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:38.914706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aef63-8657-4848-a68b-c4c63f5b3d52 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:38.915458 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aef63-8657-4848-a68b-c4c63f5b3d52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:38.915761 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aef63-8657-4848-a68b-c4c63f5b3d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:38.917169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aef63-8657-4848-a68b-c4c63f5b3d52 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:38.929202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 203/419] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:38.935473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635df27-9931-438f-aac7-5e074ff5dae8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:39.052886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635df27-9931-438f-aac7-5e074ff5dae8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:39.101386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485dfcb-70ed-4443-8e14-af4a3e07abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:39.102622 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485dfcb-70ed-4443-8e14-af4a3e07abf7 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:39.104132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485dfcb-70ed-4443-8e14-af4a3e07abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:39.104132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485dfcb-70ed-4443-8e14-af4a3e07abf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:39.180857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485dfcb-70ed-4443-8e14-af4a3e07abf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:39.182274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485dfcb-70ed-4443-8e14-af4a3e07abf7 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:39.277785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419fa26-6ecc-4d20-aa1d-8a1aa05c130d None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:39.278443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419fa26-6ecc-4d20-aa1d-8a1aa05c130d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:39.278918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419fa26-6ecc-4d20-aa1d-8a1aa05c130d None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:39.281271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 204/420] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:39.287175 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185beb-34b3-44bc-b659-776a458cf580 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:39.287454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185beb-34b3-44bc-b659-776a458cf580 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:39.287735 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185beb-34b3-44bc-b659-776a458cf580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:39.322027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f2185beb-34b3-44bc-b659-776a458cf580 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:39.323546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f2185beb-34b3-44bc-b659-776a458cf580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:39.323826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 217/421] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:39.329229 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485dfcb-70ed-4443-8e14-af4a3e07abf7 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:39.448182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 205/422] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:39.479478 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485dfcb-70ed-4443-8e14-af4a3e07abf7 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:39.486964 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2185beb-34b3-44bc-b659-776a458cf580 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:39.527715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d08c-06f5-4383-a7da-715019769c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:39.528597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d08c-06f5-4383-a7da-715019769c4b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:39.528870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d08c-06f5-4383-a7da-715019769c4b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:39.529137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d08c-06f5-4383-a7da-715019769c4b None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:39.534828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5d08c-06f5-4383-a7da-715019769c4b None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:39.536283 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5d08c-06f5-4383-a7da-715019769c4b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:39.538495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 218/423] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:39 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:39.544691 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d08c-06f5-4383-a7da-715019769c4b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:39.635965 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2185beb-34b3-44bc-b659-776a458cf580 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:39.705914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedeec9e-a930-45d4-a788-3a6893b28155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:39.707110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeec9e-a930-45d4-a788-3a6893b28155 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:39.707611 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeec9e-a930-45d4-a788-3a6893b28155 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:39.709133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeec9e-a930-45d4-a788-3a6893b28155 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:39.729160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedeec9e-a930-45d4-a788-3a6893b28155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:39.736105 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d08c-06f5-4383-a7da-715019769c4b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:39.745484 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-aedeec9e-a930-45d4-a788-3a6893b28155 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:39.753827 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 206/424] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:39.761137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedeec9e-a930-45d4-a788-3a6893b28155 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:39.809762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712a79-7252-4f46-a176-9e21fb0fc5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:39.810661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712a79-7252-4f46-a176-9e21fb0fc5da None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:39.811103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712a79-7252-4f46-a176-9e21fb0fc5da None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:39.811545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21712a79-7252-4f46-a176-9e21fb0fc5da None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:39.818925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21712a79-7252-4f46-a176-9e21fb0fc5da None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:39.820694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21712a79-7252-4f46-a176-9e21fb0fc5da None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:39.823141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 219/425] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:39 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:39.830998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712a79-7252-4f46-a176-9e21fb0fc5da None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:39.895495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedeec9e-a930-45d4-a788-3a6893b28155 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:39.932841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd7810-5dd5-49df-b711-60638ac86853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:39.934422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7810-5dd5-49df-b711-60638ac86853 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:39.935158 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7810-5dd5-49df-b711-60638ac86853 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:39.935913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7810-5dd5-49df-b711-60638ac86853 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:39.937454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd7810-5dd5-49df-b711-60638ac86853 None admin] RBAC: Adding query filter params (name=member) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:39.938270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd7810-5dd5-49df-b711-60638ac86853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:39.940216 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd7810-5dd5-49df-b711-60638ac86853 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:39.949862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 207/426] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:39.958973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd7810-5dd5-49df-b711-60638ac86853 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:40.041810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21712a79-7252-4f46-a176-9e21fb0fc5da None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:40.118776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382699-6d31-40f6-9a14-c767a382d383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:40.119817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382699-6d31-40f6-9a14-c767a382d383 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:40.120300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382699-6d31-40f6-9a14-c767a382d383 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:40.120797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382699-6d31-40f6-9a14-c767a382d383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:40.121827 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382699-6d31-40f6-9a14-c767a382d383 None admin] RBAC: Adding query filter params (group.id=e37010764bde43a7aaf0ac545da4757d, role.id=e83d49af62db4f4aa2dcadb10a82bfdc, scope.project.id=7b3f655528294e62a0a33ce69e504013) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:40.122378 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382699-6d31-40f6-9a14-c767a382d383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:40.124000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382699-6d31-40f6-9a14-c767a382d383 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:40.126878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd7810-5dd5-49df-b711-60638ac86853 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:40.136792 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 220/427] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Feb 28 21:35:39 2022] GET /identity/v3/role_assignments?group.id=e37010764bde43a7aaf0ac545da4757d&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=e83d49af62db4f4aa2dcadb10a82bfdc => generated 611 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:40.182856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f3484-c11c-4573-87a2-09e2b6b45133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:40.183544 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f3484-c11c-4573-87a2-09e2b6b45133 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:40.183826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f3484-c11c-4573-87a2-09e2b6b45133 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:40.184096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f3484-c11c-4573-87a2-09e2b6b45133 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:40.218577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5c5b2-8757-4779-a852-351cac460e91 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:40.218892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5c5b2-8757-4779-a852-351cac460e91 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:40.219082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5c5b2-8757-4779-a852-351cac460e91 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:40.220858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 221/428] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:40.226294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4b600-afc3-4fe7-a981-73d7740aa468 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:40.226651 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4b600-afc3-4fe7-a981-73d7740aa468 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:40.226910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4b600-afc3-4fe7-a981-73d7740aa468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:40.261377 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-88c4b600-afc3-4fe7-a981-73d7740aa468 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:40.262918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-88c4b600-afc3-4fe7-a981-73d7740aa468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:40.291517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f3484-c11c-4573-87a2-09e2b6b45133 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:40.293327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f3484-c11c-4573-87a2-09e2b6b45133 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:40.387995 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 222/429] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:40.412052 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4b600-afc3-4fe7-a981-73d7740aa468 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:40.448639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 208/430] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:40.449798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f3484-c11c-4573-87a2-09e2b6b45133 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:40.529944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4b600-afc3-4fe7-a981-73d7740aa468 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:40.551848 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f3484-c11c-4573-87a2-09e2b6b45133 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:40.568545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bd06e-eef9-403c-8dee-6e33134ea12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:40.569799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bd06e-eef9-403c-8dee-6e33134ea12d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:40.570490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bd06e-eef9-403c-8dee-6e33134ea12d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:40.571181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bd06e-eef9-403c-8dee-6e33134ea12d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:40.583888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bd06e-eef9-403c-8dee-6e33134ea12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:40.587622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19d2ae-ef69-459e-8e29-32db4d8830a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:40.588485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19d2ae-ef69-459e-8e29-32db4d8830a4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:40.588765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19d2ae-ef69-459e-8e29-32db4d8830a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:40.589040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19d2ae-ef69-459e-8e29-32db4d8830a4 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:40.590273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19d2ae-ef69-459e-8e29-32db4d8830a4 None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:40.591706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19d2ae-ef69-459e-8e29-32db4d8830a4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:40.593427 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-1b3bd06e-eef9-403c-8dee-6e33134ea12d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 28 21:35:40.593680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 209/431] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:40 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:40.595459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 223/432] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:40.599009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19d2ae-ef69-459e-8e29-32db4d8830a4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:40.600533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bd06e-eef9-403c-8dee-6e33134ea12d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:40.700533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19d2ae-ef69-459e-8e29-32db4d8830a4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:40.701691 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bd06e-eef9-403c-8dee-6e33134ea12d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:40.735195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d9994-899a-4847-bf84-2bb927379ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:40.736134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888145f1-02a7-4382-9226-e9ff3a28b636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:40.736601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d9994-899a-4847-bf84-2bb927379ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:40.736601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d9994-899a-4847-bf84-2bb927379ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:40.736831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d9994-899a-4847-bf84-2bb927379ff7 None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:40.737724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888145f1-02a7-4382-9226-e9ff3a28b636 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:40.738227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d9994-899a-4847-bf84-2bb927379ff7 None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:40.738491 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888145f1-02a7-4382-9226-e9ff3a28b636 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:40.738949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888145f1-02a7-4382-9226-e9ff3a28b636 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:40.739659 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d9994-899a-4847-bf84-2bb927379ff7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:40.740110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888145f1-02a7-4382-9226-e9ff3a28b636 None admin] RBAC: Adding query filter params (name=member) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:40.740599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888145f1-02a7-4382-9226-e9ff3a28b636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:40.741564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 210/433] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:40 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:40.743284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888145f1-02a7-4382-9226-e9ff3a28b636 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:40.747974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d9994-899a-4847-bf84-2bb927379ff7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:40.753140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 224/434] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:35:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:40.758507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888145f1-02a7-4382-9226-e9ff3a28b636 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:40.858203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d9994-899a-4847-bf84-2bb927379ff7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:40.886451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888145f1-02a7-4382-9226-e9ff3a28b636 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:40.901341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485371-dd35-43fe-ab20-38745fad60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:40.902393 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485371-dd35-43fe-ab20-38745fad60a2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:40.902922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485371-dd35-43fe-ab20-38745fad60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:40.903199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485371-dd35-43fe-ab20-38745fad60a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:40.904026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47485371-dd35-43fe-ab20-38745fad60a2 None admin] RBAC: Adding query filter params (group.id=e37010764bde43a7aaf0ac545da4757d, role.id=b15932e4d63b437eb478fd41d0ae6ec6, scope.project.id=aae7a29125d84943bd6b641569d01895) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:40.904486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47485371-dd35-43fe-ab20-38745fad60a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:40.906239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47485371-dd35-43fe-ab20-38745fad60a2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:40.922028 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 211/435] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Feb 28 21:35:40 2022] GET /identity/v3/role_assignments?group.id=e37010764bde43a7aaf0ac545da4757d&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:40.927214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66c214-9571-46a5-8bb5-f8001f097edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:40.927889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66c214-9571-46a5-8bb5-f8001f097edc None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:40.928168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66c214-9571-46a5-8bb5-f8001f097edc None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:40.928441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66c214-9571-46a5-8bb5-f8001f097edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.007742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66c214-9571-46a5-8bb5-f8001f097edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:41.009253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66c214-9571-46a5-8bb5-f8001f097edc None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:41.118647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 225/436] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:41.123692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485371-dd35-43fe-ab20-38745fad60a2 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:41.224549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485371-dd35-43fe-ab20-38745fad60a2 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:41.255907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653994e-817a-4b2d-9751-554c01fbf6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:41.256763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653994e-817a-4b2d-9751-554c01fbf6f5 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.257038 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653994e-817a-4b2d-9751-554c01fbf6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.257307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653994e-817a-4b2d-9751-554c01fbf6f5 None admin] PATH_INFO: `/v3/projects/7b3f655528294e62a0a33ce69e504013` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.259119 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653994e-817a-4b2d-9751-554c01fbf6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=7b3f655528294e62a0a33ce69e504013)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:41.260789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653994e-817a-4b2d-9751-554c01fbf6f5 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:41.262668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 212/437] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:41 2022] GET /identity/v3/projects/7b3f655528294e62a0a33ce69e504013 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:41.267989 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66c214-9571-46a5-8bb5-f8001f097edc None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:41.300364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19a111-5977-4cec-b3bc-ac8e95677302 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.300649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19a111-5977-4cec-b3bc-ac8e95677302 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.300923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19a111-5977-4cec-b3bc-ac8e95677302 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.302724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 213/438] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:41.308352 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8fb06-c973-44dc-bcaa-326906af8f61 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.308847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8fb06-c973-44dc-bcaa-326906af8f61 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.309602 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8fb06-c973-44dc-bcaa-326906af8f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.330147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8ea8fb06-c973-44dc-bcaa-326906af8f61 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:41.331337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8ea8fb06-c973-44dc-bcaa-326906af8f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:41.368983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66c214-9571-46a5-8bb5-f8001f097edc None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:41.404242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71bacd-f636-47ce-a4f4-3bf63cf0ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:41.404434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 214/439] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:41.404536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71bacd-f636-47ce-a4f4-3bf63cf0ac9b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.404536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71bacd-f636-47ce-a4f4-3bf63cf0ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.404536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71bacd-f636-47ce-a4f4-3bf63cf0ac9b None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.404845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71bacd-f636-47ce-a4f4-3bf63cf0ac9b None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:41.406293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71bacd-f636-47ce-a4f4-3bf63cf0ac9b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:41.407915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 226/440] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:41 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:41.413953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8fb06-c973-44dc-bcaa-326906af8f61 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:41.414802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb67c2-8c9d-4acc-b2aa-6ce98ebb7a15 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.415082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb67c2-8c9d-4acc-b2aa-6ce98ebb7a15 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.415353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb67c2-8c9d-4acc-b2aa-6ce98ebb7a15 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.417036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 227/441] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:41.420346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb67c2-8c9d-4acc-b2aa-6ce98ebb7a15 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:41.508780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8fb06-c973-44dc-bcaa-326906af8f61 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:41.515152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb67c2-8c9d-4acc-b2aa-6ce98ebb7a15 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:41.540574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030cbef-fe9e-4e81-bce6-09c170c5d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:41.541220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030cbef-fe9e-4e81-bce6-09c170c5d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.541496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030cbef-fe9e-4e81-bce6-09c170c5d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.541771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030cbef-fe9e-4e81-bce6-09c170c5d4f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.542627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030cbef-fe9e-4e81-bce6-09c170c5d4f5 None admin] RBAC: Adding query filter params (group.id=e37010764bde43a7aaf0ac545da4757d, role.id=b15932e4d63b437eb478fd41d0ae6ec6, scope.project.id=7b3f655528294e62a0a33ce69e504013) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:41.542971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030cbef-fe9e-4e81-bce6-09c170c5d4f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:41.544416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030cbef-fe9e-4e81-bce6-09c170c5d4f5 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:41.545925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7a43a-27bc-4ff3-8c3d-f0c1ad1afda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:41.546724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7a43a-27bc-4ff3-8c3d-f0c1ad1afda0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.547017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7a43a-27bc-4ff3-8c3d-f0c1ad1afda0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.547274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7a43a-27bc-4ff3-8c3d-f0c1ad1afda0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.550240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 215/442] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Feb 28 21:35:41 2022] GET /identity/v3/role_assignments?group.id=e37010764bde43a7aaf0ac545da4757d&scope.project.id=7b3f655528294e62a0a33ce69e504013&role.id=b15932e4d63b437eb478fd41d0ae6ec6 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:41.551465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc94ae-54e5-424d-88fe-f846f82aaffd None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.551755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc94ae-54e5-424d-88fe-f846f82aaffd None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.552026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc94ae-54e5-424d-88fe-f846f82aaffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.558946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7a43a-27bc-4ff3-8c3d-f0c1ad1afda0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:41.566108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-4ed7a43a-27bc-4ff3-8c3d-f0c1ad1afda0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:35:41.567556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 228/443] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:35:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:41.574059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7a43a-27bc-4ff3-8c3d-f0c1ad1afda0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:41.575049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-23dc94ae-54e5-424d-88fe-f846f82aaffd None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:41.576251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-23dc94ae-54e5-424d-88fe-f846f82aaffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:41.648941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 216/444] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:41.672178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc94ae-54e5-424d-88fe-f846f82aaffd None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:41.679332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7a43a-27bc-4ff3-8c3d-f0c1ad1afda0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:41.715563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17d85f-0bb1-4137-9a4a-db90e361cdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:41.716402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17d85f-0bb1-4137-9a4a-db90e361cdb0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.716687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17d85f-0bb1-4137-9a4a-db90e361cdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.716962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17d85f-0bb1-4137-9a4a-db90e361cdb0 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.717719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17d85f-0bb1-4137-9a4a-db90e361cdb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:41.718046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17d85f-0bb1-4137-9a4a-db90e361cdb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:41.719423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17d85f-0bb1-4137-9a4a-db90e361cdb0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:41.728454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 229/445] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:41.733557 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17d85f-0bb1-4137-9a4a-db90e361cdb0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:41.778932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc94ae-54e5-424d-88fe-f846f82aaffd None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:41.819231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c92723-f67c-470e-8444-1a093694486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:41.821403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c92723-f67c-470e-8444-1a093694486a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.822353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c92723-f67c-470e-8444-1a093694486a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.822464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c92723-f67c-470e-8444-1a093694486a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.837444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c92723-f67c-470e-8444-1a093694486a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:41.845001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17d85f-0bb1-4137-9a4a-db90e361cdb0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:41.845937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-75c92723-f67c-470e-8444-1a093694486a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:41.847377 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 217/446] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:41.853879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c92723-f67c-470e-8444-1a093694486a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:41.889489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb1ad-f726-4559-9941-185bc9b96ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:41.890209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb1ad-f726-4559-9941-185bc9b96ed1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:41.890596 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb1ad-f726-4559-9941-185bc9b96ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:41.890953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb1ad-f726-4559-9941-185bc9b96ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:41.968970 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c92723-f67c-470e-8444-1a093694486a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:41.973828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbb1ad-f726-4559-9941-185bc9b96ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:41.974800 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbb1ad-f726-4559-9941-185bc9b96ed1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:42.015178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6c616-f0be-43a2-8d98-c0c6cae4e16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:42.016093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6c616-f0be-43a2-8d98-c0c6cae4e16e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:42.016560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6c616-f0be-43a2-8d98-c0c6cae4e16e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:42.016833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6c616-f0be-43a2-8d98-c0c6cae4e16e None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:42.017588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6c616-f0be-43a2-8d98-c0c6cae4e16e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:42.017896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6c616-f0be-43a2-8d98-c0c6cae4e16e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:42.019345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6c616-f0be-43a2-8d98-c0c6cae4e16e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:42.028810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 218/447] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:42.034721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6c616-f0be-43a2-8d98-c0c6cae4e16e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:42.098766 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 230/448] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 21:35:42.104446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb1ad-f726-4559-9941-185bc9b96ed1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:42.144545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6c616-f0be-43a2-8d98-c0c6cae4e16e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:42.181771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faacc3-05f7-405e-bd87-0b9644b0a8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:42.182585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faacc3-05f7-405e-bd87-0b9644b0a8a4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:42.182937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faacc3-05f7-405e-bd87-0b9644b0a8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:42.183280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faacc3-05f7-405e-bd87-0b9644b0a8a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:42.225620 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb1ad-f726-4559-9941-185bc9b96ed1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:42.256386 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faacc3-05f7-405e-bd87-0b9644b0a8a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:42.258042 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faacc3-05f7-405e-bd87-0b9644b0a8a4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:42.263590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6decae-9e0e-4b7c-b2ab-f06e267fbb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:42.264436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6decae-9e0e-4b7c-b2ab-f06e267fbb06 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:42.264711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6decae-9e0e-4b7c-b2ab-f06e267fbb06 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:42.264977 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6decae-9e0e-4b7c-b2ab-f06e267fbb06 None admin] PATH_INFO: `/v3/projects/7297e55969ab4bf0b026f4e20d2cae80` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:42.266186 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6decae-9e0e-4b7c-b2ab-f06e267fbb06 None admin] RBAC: Authorizing `identity:get_project(project_id=7297e55969ab4bf0b026f4e20d2cae80)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:42.267602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6decae-9e0e-4b7c-b2ab-f06e267fbb06 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:42.269284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 231/449] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:42 2022] GET /identity/v3/projects/7297e55969ab4bf0b026f4e20d2cae80 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:42.275272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6decae-9e0e-4b7c-b2ab-f06e267fbb06 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:42.355614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 219/450] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Feb 28 21:35:42.361170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faacc3-05f7-405e-bd87-0b9644b0a8a4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:42.368482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6decae-9e0e-4b7c-b2ab-f06e267fbb06 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:42.400320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29313832-9b43-4a22-a59b-2a80770692fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:42.401151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313832-9b43-4a22-a59b-2a80770692fe None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:42.401425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313832-9b43-4a22-a59b-2a80770692fe None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:42.401693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29313832-9b43-4a22-a59b-2a80770692fe None admin] PATH_INFO: `/v3/groups/242f26cc0acd4938a84a835c867ecd5f` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:42.402879 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29313832-9b43-4a22-a59b-2a80770692fe None admin] RBAC: Authorizing `identity:get_group(group_id=242f26cc0acd4938a84a835c867ecd5f)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:42.404298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29313832-9b43-4a22-a59b-2a80770692fe None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:42.405873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 232/451] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:42 2022] GET /identity/v3/groups/242f26cc0acd4938a84a835c867ecd5f => generated 229 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:42.411535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29313832-9b43-4a22-a59b-2a80770692fe None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:42.452183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faacc3-05f7-405e-bd87-0b9644b0a8a4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:42.484064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc11928-6aa5-41bb-9bb0-9053fb7729e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:42.484833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc11928-6aa5-41bb-9bb0-9053fb7729e9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:42.485119 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc11928-6aa5-41bb-9bb0-9053fb7729e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:42.485386 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc11928-6aa5-41bb-9bb0-9053fb7729e9 None admin] PATH_INFO: `/v3/projects/aae7a29125d84943bd6b641569d01895` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:42.486570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc11928-6aa5-41bb-9bb0-9053fb7729e9 None admin] RBAC: Authorizing `identity:get_project(project_id=aae7a29125d84943bd6b641569d01895)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:42.487984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc11928-6aa5-41bb-9bb0-9053fb7729e9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:42.489801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 220/452] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:35:42 2022] GET /identity/v3/projects/aae7a29125d84943bd6b641569d01895 => generated 302 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:42.495204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc11928-6aa5-41bb-9bb0-9053fb7729e9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:42.505239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29313832-9b43-4a22-a59b-2a80770692fe None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:42.537961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550f14f-3297-4971-9973-84ae235eebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:42.538623 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f14f-3297-4971-9973-84ae235eebe8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:42.539447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f14f-3297-4971-9973-84ae235eebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:42.539721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550f14f-3297-4971-9973-84ae235eebe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:42.540535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550f14f-3297-4971-9973-84ae235eebe8 None admin] RBAC: Adding query filter params (group.id=242f26cc0acd4938a84a835c867ecd5f, role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=7297e55969ab4bf0b026f4e20d2cae80) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:42.540836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550f14f-3297-4971-9973-84ae235eebe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:42.542267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550f14f-3297-4971-9973-84ae235eebe8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:42.547761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 233/453] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Feb 28 21:35:42 2022] GET /identity/v3/role_assignments?group.id=242f26cc0acd4938a84a835c867ecd5f&scope.project.id=7297e55969ab4bf0b026f4e20d2cae80&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:42.591409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc11928-6aa5-41bb-9bb0-9053fb7729e9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:42.626893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceea9a-7e2a-4c7a-b97e-2d333d6a3551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:42.627759 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceea9a-7e2a-4c7a-b97e-2d333d6a3551 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:42.628030 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceea9a-7e2a-4c7a-b97e-2d333d6a3551 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:42.628294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceea9a-7e2a-4c7a-b97e-2d333d6a3551 None admin] PATH_INFO: `/v3/groups/e37010764bde43a7aaf0ac545da4757d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:42.629531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceea9a-7e2a-4c7a-b97e-2d333d6a3551 None admin] RBAC: Authorizing `identity:get_group(group_id=e37010764bde43a7aaf0ac545da4757d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:42.631010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceea9a-7e2a-4c7a-b97e-2d333d6a3551 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:42.632708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 221/454] 10.222.0.26 () {56 vars in 1180 bytes} [Mon Feb 28 21:35:42 2022] GET /identity/v3/groups/e37010764bde43a7aaf0ac545da4757d => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:42.639146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550f14f-3297-4971-9973-84ae235eebe8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:42.739786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550f14f-3297-4971-9973-84ae235eebe8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:42.773034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f24a43-f6ff-4f2a-b524-dc8e42185969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:42.773864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f24a43-f6ff-4f2a-b524-dc8e42185969 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:42.774174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f24a43-f6ff-4f2a-b524-dc8e42185969 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:42.774447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f24a43-f6ff-4f2a-b524-dc8e42185969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:42.775269 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f24a43-f6ff-4f2a-b524-dc8e42185969 None admin] RBAC: Adding query filter params (group.id=e37010764bde43a7aaf0ac545da4757d, role.id=e83d49af62db4f4aa2dcadb10a82bfdc, scope.project.id=aae7a29125d84943bd6b641569d01895) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:42.775577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f24a43-f6ff-4f2a-b524-dc8e42185969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:42.777009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f24a43-f6ff-4f2a-b524-dc8e42185969 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:42.782669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 234/455] 10.222.0.26 () {56 vars in 1376 bytes} [Mon Feb 28 21:35:42 2022] GET /identity/v3/role_assignments?group.id=e37010764bde43a7aaf0ac545da4757d&scope.project.id=aae7a29125d84943bd6b641569d01895&role.id=e83d49af62db4f4aa2dcadb10a82bfdc => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:45.886171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c916dc9-4e13-40d1-af5c-8d49946f47cc None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:45.886676 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c916dc9-4e13-40d1-af5c-8d49946f47cc None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:45.886748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c916dc9-4e13-40d1-af5c-8d49946f47cc None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:45.888753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 222/456] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:45.894309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a3305-9386-4b3e-bccf-0fb14a25fd3d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:45.894707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a3305-9386-4b3e-bccf-0fb14a25fd3d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:45.894867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a3305-9386-4b3e-bccf-0fb14a25fd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:45.918987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-680a3305-9386-4b3e-bccf-0fb14a25fd3d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:45.920188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-680a3305-9386-4b3e-bccf-0fb14a25fd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:46.005268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 235/457] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:46.043032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c916dc9-4e13-40d1-af5c-8d49946f47cc None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:46.049342 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d974dea-091a-440d-88a3-f624b2e0ab3e None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.049872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d974dea-091a-440d-88a3-f624b2e0ab3e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.050397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d974dea-091a-440d-88a3-f624b2e0ab3e None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.052729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 236/458] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:46.058456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993299d-4000-416c-a9aa-6a42c8ad763b None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.059113 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993299d-4000-416c-a9aa-6a42c8ad763b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.059600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993299d-4000-416c-a9aa-6a42c8ad763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.076402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0993299d-4000-416c-a9aa-6a42c8ad763b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:46.077861 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0993299d-4000-416c-a9aa-6a42c8ad763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:46.151610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 237/459] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:46.175688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c916dc9-4e13-40d1-af5c-8d49946f47cc None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:46.176710 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993299d-4000-416c-a9aa-6a42c8ad763b None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:46.225459 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2953e1a-f342-4a92-b2dd-bb7422d2a8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:46.226368 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2953e1a-f342-4a92-b2dd-bb7422d2a8c0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.226930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2953e1a-f342-4a92-b2dd-bb7422d2a8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.226930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2953e1a-f342-4a92-b2dd-bb7422d2a8c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.239891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2953e1a-f342-4a92-b2dd-bb7422d2a8c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:46.241337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2953e1a-f342-4a92-b2dd-bb7422d2a8c0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:46.267330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-a2953e1a-f342-4a92-b2dd-bb7422d2a8c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:46.268976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 223/460] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:46.277797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993299d-4000-416c-a9aa-6a42c8ad763b None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:46.278992 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2953e1a-f342-4a92-b2dd-bb7422d2a8c0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:46.315231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02be38-025f-432d-b2ba-554e45c648b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:46.316587 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02be38-025f-432d-b2ba-554e45c648b4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.317066 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02be38-025f-432d-b2ba-554e45c648b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.317537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02be38-025f-432d-b2ba-554e45c648b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.329552 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02be38-025f-432d-b2ba-554e45c648b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:46.331336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02be38-025f-432d-b2ba-554e45c648b4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:46.348475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-8b02be38-025f-432d-b2ba-554e45c648b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:46.354332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 238/461] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:46.355873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f5968-ebb2-410e-9aff-b4e82b7299fc None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.356303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f5968-ebb2-410e-9aff-b4e82b7299fc None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.356779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f5968-ebb2-410e-9aff-b4e82b7299fc None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.359108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 239/462] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:46.361713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f5968-ebb2-410e-9aff-b4e82b7299fc None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:46.406735 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2953e1a-f342-4a92-b2dd-bb7422d2a8c0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:46.439769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60d1ad-2752-4e85-8a13-8d19e6a8888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:46.440430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60d1ad-2752-4e85-8a13-8d19e6a8888e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.440708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60d1ad-2752-4e85-8a13-8d19e6a8888e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.440979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60d1ad-2752-4e85-8a13-8d19e6a8888e None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.441694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60d1ad-2752-4e85-8a13-8d19e6a8888e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:46.442016 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60d1ad-2752-4e85-8a13-8d19e6a8888e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:46.443380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60d1ad-2752-4e85-8a13-8d19e6a8888e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:46.461660 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 224/463] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:46.463034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f935a7-17ed-429f-bd82-a24b6e3e6c0c None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.463323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f935a7-17ed-429f-bd82-a24b6e3e6c0c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.463596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f935a7-17ed-429f-bd82-a24b6e3e6c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.468463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f5968-ebb2-410e-9aff-b4e82b7299fc None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:46.480160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-88f935a7-17ed-429f-bd82-a24b6e3e6c0c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:46.481525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-88f935a7-17ed-429f-bd82-a24b6e3e6c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:46.502409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9a772-98c8-4e06-be13-3c3f2f731b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:46.503065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9a772-98c8-4e06-be13-3c3f2f731b48 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.503341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9a772-98c8-4e06-be13-3c3f2f731b48 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.503608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9a772-98c8-4e06-be13-3c3f2f731b48 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.504315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9a772-98c8-4e06-be13-3c3f2f731b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:46.504611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9a772-98c8-4e06-be13-3c3f2f731b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:46.505940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9a772-98c8-4e06-be13-3c3f2f731b48 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:46.518231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 240/464] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:46.519513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4356fb-e980-40fd-844d-0aecaa8ad6a5 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.519804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4356fb-e980-40fd-844d-0aecaa8ad6a5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.520079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4356fb-e980-40fd-844d-0aecaa8ad6a5 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.526283 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 241/465] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:46.526283 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4356fb-e980-40fd-844d-0aecaa8ad6a5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:46.555110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 225/466] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:46.556319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f935a7-17ed-429f-bd82-a24b6e3e6c0c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:46.632919 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4356fb-e980-40fd-844d-0aecaa8ad6a5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:46.669918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc7ca7-d67f-4483-8601-ef003415bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:46.670533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc7ca7-d67f-4483-8601-ef003415bdcc None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.670817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc7ca7-d67f-4483-8601-ef003415bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.671092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc7ca7-d67f-4483-8601-ef003415bdcc None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.671802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc7ca7-d67f-4483-8601-ef003415bdcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:46.672516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f935a7-17ed-429f-bd82-a24b6e3e6c0c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:46.673226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc7ca7-d67f-4483-8601-ef003415bdcc None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:46.707663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d0aa6-dcd7-45b0-b8bd-9fae026d15f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:46.708343 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d0aa6-dcd7-45b0-b8bd-9fae026d15f4 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.708622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d0aa6-dcd7-45b0-b8bd-9fae026d15f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.708892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d0aa6-dcd7-45b0-b8bd-9fae026d15f4 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.709605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d0aa6-dcd7-45b0-b8bd-9fae026d15f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:46.711838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d0aa6-dcd7-45b0-b8bd-9fae026d15f4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:46.776336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 242/467] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:35:46 2022] POST /identity/v3/users => generated 246 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:35:46.777758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979bafe-c746-4439-a406-333bf015138a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:46.778136 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979bafe-c746-4439-a406-333bf015138a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:46.778507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979bafe-c746-4439-a406-333bf015138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:46.803350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4979bafe-c746-4439-a406-333bf015138a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:46.804715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4979bafe-c746-4439-a406-333bf015138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:46.806022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 226/468] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:35:46 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:35:46.807234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d0aa6-dcd7-45b0-b8bd-9fae026d15f4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:46.945104 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 243/469] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:46.971822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d0aa6-dcd7-45b0-b8bd-9fae026d15f4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:46.987137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979bafe-c746-4439-a406-333bf015138a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:47.019401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38392715-286d-41cc-91f7-72d0d6e249d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:47.020605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38392715-286d-41cc-91f7-72d0d6e249d2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:47.020882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38392715-286d-41cc-91f7-72d0d6e249d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:47.021150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38392715-286d-41cc-91f7-72d0d6e249d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:47.034622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38392715-286d-41cc-91f7-72d0d6e249d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:47.036417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38392715-286d-41cc-91f7-72d0d6e249d2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:47.055276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-38392715-286d-41cc-91f7-72d0d6e249d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:47.056893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 227/470] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:47.062924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38392715-286d-41cc-91f7-72d0d6e249d2 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:47.182637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979bafe-c746-4439-a406-333bf015138a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:47.185951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38392715-286d-41cc-91f7-72d0d6e249d2 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:47.218348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5876ec1-884a-4742-bada-9d1d6f11db1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:47.219328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5876ec1-884a-4742-bada-9d1d6f11db1a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:47.219446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5876ec1-884a-4742-bada-9d1d6f11db1a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:47.219772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5876ec1-884a-4742-bada-9d1d6f11db1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:47.228520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25e0ac-0643-4f94-b9dc-203db3e4342b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:47.229866 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e0ac-0643-4f94-b9dc-203db3e4342b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:47.230659 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e0ac-0643-4f94-b9dc-203db3e4342b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:47.231133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e0ac-0643-4f94-b9dc-203db3e4342b None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:47.231418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5876ec1-884a-4742-bada-9d1d6f11db1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:47.232254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25e0ac-0643-4f94-b9dc-203db3e4342b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:47.232743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25e0ac-0643-4f94-b9dc-203db3e4342b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:47.233064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5876ec1-884a-4742-bada-9d1d6f11db1a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:47.234521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25e0ac-0643-4f94-b9dc-203db3e4342b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:47.248886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 228/471] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:47.250607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d1e8e-6f6a-449f-bde8-90fd4b0654f3 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:47.251067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d1e8e-6f6a-449f-bde8-90fd4b0654f3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:47.251521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d1e8e-6f6a-449f-bde8-90fd4b0654f3 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:47.253576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 229/472] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:47.255560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a5876ec1-884a-4742-bada-9d1d6f11db1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:47.257002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 244/473] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:47.262988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5876ec1-884a-4742-bada-9d1d6f11db1a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:47.263843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9031-20f4-499c-9799-223dac93eea7 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:47.264328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9031-20f4-499c-9799-223dac93eea7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:47.264777 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9031-20f4-499c-9799-223dac93eea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:47.288098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-eceb9031-20f4-499c-9799-223dac93eea7 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:47.291496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-eceb9031-20f4-499c-9799-223dac93eea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:47.369883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5876ec1-884a-4742-bada-9d1d6f11db1a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:47.380101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 230/474] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:47.381561 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9031-20f4-499c-9799-223dac93eea7 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:47.410966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea42e8-f66b-4bed-8db4-80e4e7ae0959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:47.412047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea42e8-f66b-4bed-8db4-80e4e7ae0959 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:47.412689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea42e8-f66b-4bed-8db4-80e4e7ae0959 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:47.413149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea42e8-f66b-4bed-8db4-80e4e7ae0959 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:47.415024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea42e8-f66b-4bed-8db4-80e4e7ae0959 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:47.416459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea42e8-f66b-4bed-8db4-80e4e7ae0959 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:47.494810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9031-20f4-499c-9799-223dac93eea7 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:47.524960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 245/475] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:35:47 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:35:47.529545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea42e8-f66b-4bed-8db4-80e4e7ae0959 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:47.543695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9d543-8eb0-4b2d-81c8-b5229e18a8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:47.544749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9d543-8eb0-4b2d-81c8-b5229e18a8d2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:47.545678 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9d543-8eb0-4b2d-81c8-b5229e18a8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:47.546232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9d543-8eb0-4b2d-81c8-b5229e18a8d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:47.547204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9d543-8eb0-4b2d-81c8-b5229e18a8d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:47.547705 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9d543-8eb0-4b2d-81c8-b5229e18a8d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:47.549351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9d543-8eb0-4b2d-81c8-b5229e18a8d2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:47.565188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 231/476] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:47.572533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9d543-8eb0-4b2d-81c8-b5229e18a8d2 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:47.699624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9d543-8eb0-4b2d-81c8-b5229e18a8d2 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:47.738772 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce633-f908-4d39-b65c-23b63c40860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:47.739457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce633-f908-4d39-b65c-23b63c40860a None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:47.739734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce633-f908-4d39-b65c-23b63c40860a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:47.740011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce633-f908-4d39-b65c-23b63c40860a None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:47.740738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afce633-f908-4d39-b65c-23b63c40860a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:47.743023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afce633-f908-4d39-b65c-23b63c40860a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:47.780111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea42e8-f66b-4bed-8db4-80e4e7ae0959 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:47.807424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d7b58-5b59-49a3-8214-249baee8b175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:47.808093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d7b58-5b59-49a3-8214-249baee8b175 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:47.808380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d7b58-5b59-49a3-8214-249baee8b175 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:47.808644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d7b58-5b59-49a3-8214-249baee8b175 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:47.809387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d7b58-5b59-49a3-8214-249baee8b175 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:47.810794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d7b58-5b59-49a3-8214-249baee8b175 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:47.844243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 232/477] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:35:47 2022] POST /identity/v3/users => generated 249 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:35:47.871807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.sql.core [None req-7e1d7b58-5b59-49a3-8214-249baee8b175 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 28 21:35:47.871807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 28 21:35:47.871807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [parameters: {'id': '0c9827cf386c4bf98dd21cc5c50dc806', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 28 21:35:47.871807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86286) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 21:35:47.887680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-7e1d7b58-5b59-49a3-8214-249baee8b175 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 28 21:35:47.889395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 246/478] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Feb 28 21:35:47 2022] POST /identity/v3/roles => generated 144 bytes in 364 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:47.895629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce633-f908-4d39-b65c-23b63c40860a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:48.006087 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce633-f908-4d39-b65c-23b63c40860a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:48.043487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7a151-2b44-4339-b6cc-2877d51bc11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:48.044220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7a151-2b44-4339-b6cc-2877d51bc11a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:48.044497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7a151-2b44-4339-b6cc-2877d51bc11a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:48.044770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7a151-2b44-4339-b6cc-2877d51bc11a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:48.055462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7a151-2b44-4339-b6cc-2877d51bc11a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:48.062937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-70e7a151-2b44-4339-b6cc-2877d51bc11a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 28 21:35:48.068816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 233/479] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:48.071131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d7b58-5b59-49a3-8214-249baee8b175 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:48.175129 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d7b58-5b59-49a3-8214-249baee8b175 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:48.213179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bb4de-6ac3-4efa-90bc-c9beb65e32a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:48.213856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bb4de-6ac3-4efa-90bc-c9beb65e32a8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:48.214175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bb4de-6ac3-4efa-90bc-c9beb65e32a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:48.214449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bb4de-6ac3-4efa-90bc-c9beb65e32a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:48.215204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bb4de-6ac3-4efa-90bc-c9beb65e32a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:48.215508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bb4de-6ac3-4efa-90bc-c9beb65e32a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:48.216888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bb4de-6ac3-4efa-90bc-c9beb65e32a8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:48.225614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 247/480] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:49.543572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbf4f-01f7-4808-a7b6-7dbb8478b72d None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:49.544107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbf4f-01f7-4808-a7b6-7dbb8478b72d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:49.544107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bbf4f-01f7-4808-a7b6-7dbb8478b72d None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:49.546390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 234/481] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:49.549585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b31471-9d24-4b02-a2f2-b23ca7c745a6 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:49.550081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b31471-9d24-4b02-a2f2-b23ca7c745a6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:49.550269 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b31471-9d24-4b02-a2f2-b23ca7c745a6 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:49.551806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65db74a-e7be-479f-a1bd-656adb64aa5a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:49.552095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65db74a-e7be-479f-a1bd-656adb64aa5a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:49.552365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65db74a-e7be-479f-a1bd-656adb64aa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:49.552472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 248/482] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:49.558615 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65b63-87db-4907-ae6a-e4785e8634c2 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:49.558914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65b63-87db-4907-ae6a-e4785e8634c2 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:49.559245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d65b63-87db-4907-ae6a-e4785e8634c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:49.571234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a65db74a-e7be-479f-a1bd-656adb64aa5a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:49.572407 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a65db74a-e7be-479f-a1bd-656adb64aa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:49.591127 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-54d65b63-87db-4907-ae6a-e4785e8634c2 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:49.592352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-54d65b63-87db-4907-ae6a-e4785e8634c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:49.639375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 235/483] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:49.662445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65db74a-e7be-479f-a1bd-656adb64aa5a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:49.684645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 249/484] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:35:49.733288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d65b63-87db-4907-ae6a-e4785e8634c2 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:49.761203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65db74a-e7be-479f-a1bd-656adb64aa5a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:49.798392 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26b0a-57cf-4dc9-820b-1b570ebcd589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:49.799108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26b0a-57cf-4dc9-820b-1b570ebcd589 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:49.799385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26b0a-57cf-4dc9-820b-1b570ebcd589 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:49.799654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26b0a-57cf-4dc9-820b-1b570ebcd589 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:49.822402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba26b0a-57cf-4dc9-820b-1b570ebcd589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:49.829584 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-dba26b0a-57cf-4dc9-820b-1b570ebcd589 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:35:49.830847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 236/485] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:35:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:49.843697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26b0a-57cf-4dc9-820b-1b570ebcd589 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:49.961811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d65b63-87db-4907-ae6a-e4785e8634c2 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:49.970901 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26b0a-57cf-4dc9-820b-1b570ebcd589 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:50.016821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87f93-1811-4560-b562-28a3b1eeb62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:50.017503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87f93-1811-4560-b562-28a3b1eeb62d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.017781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87f93-1811-4560-b562-28a3b1eeb62d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.018077 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87f93-1811-4560-b562-28a3b1eeb62d None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.018840 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87f93-1811-4560-b562-28a3b1eeb62d None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:50.019147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87f93-1811-4560-b562-28a3b1eeb62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:50.020518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87f93-1811-4560-b562-28a3b1eeb62d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:50.023969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e1709-6240-4c98-8b70-938519ac8a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:50.024969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1709-6240-4c98-8b70-938519ac8a00 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.025388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1709-6240-4c98-8b70-938519ac8a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.025820 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1709-6240-4c98-8b70-938519ac8a00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.037195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e1709-6240-4c98-8b70-938519ac8a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:50.037504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 237/486] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:35:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:50.045103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-b95e1709-6240-4c98-8b70-938519ac8a00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:35:50.046796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 250/487] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:35:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:50.056776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87f93-1811-4560-b562-28a3b1eeb62d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:50.056922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e1709-6240-4c98-8b70-938519ac8a00 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:50.165124 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87f93-1811-4560-b562-28a3b1eeb62d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:50.202354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021d8ab-cd9e-4657-825d-4582f3c16b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:50.203157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021d8ab-cd9e-4657-825d-4582f3c16b27 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.203439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021d8ab-cd9e-4657-825d-4582f3c16b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.203713 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021d8ab-cd9e-4657-825d-4582f3c16b27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.225444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021d8ab-cd9e-4657-825d-4582f3c16b27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:50.229462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021d8ab-cd9e-4657-825d-4582f3c16b27 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:50.253116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-6021d8ab-cd9e-4657-825d-4582f3c16b27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:50.259411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 238/488] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:50.266219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021d8ab-cd9e-4657-825d-4582f3c16b27 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:50.289747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e1709-6240-4c98-8b70-938519ac8a00 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:50.369786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54683d80-03fd-4a58-9270-7c53428f89ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:50.370538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54683d80-03fd-4a58-9270-7c53428f89ec None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.370822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54683d80-03fd-4a58-9270-7c53428f89ec None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.371149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54683d80-03fd-4a58-9270-7c53428f89ec None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.371909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54683d80-03fd-4a58-9270-7c53428f89ec None admin] RBAC: Adding query filter params (name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:50.372215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54683d80-03fd-4a58-9270-7c53428f89ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:50.373604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54683d80-03fd-4a58-9270-7c53428f89ec None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:50.387019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 251/489] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:35:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:50.392532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021d8ab-cd9e-4657-825d-4582f3c16b27 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:50.394839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54683d80-03fd-4a58-9270-7c53428f89ec None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:50.463588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1355c9-e328-4f3f-8d8b-61c86347fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:50.464259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1355c9-e328-4f3f-8d8b-61c86347fb78 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.464538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1355c9-e328-4f3f-8d8b-61c86347fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.464809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1355c9-e328-4f3f-8d8b-61c86347fb78 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.465528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1355c9-e328-4f3f-8d8b-61c86347fb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:50.465828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1355c9-e328-4f3f-8d8b-61c86347fb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:50.467212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1355c9-e328-4f3f-8d8b-61c86347fb78 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:50.496377 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 239/490] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:50.497705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54683d80-03fd-4a58-9270-7c53428f89ec None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:50.502203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1355c9-e328-4f3f-8d8b-61c86347fb78 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:50.532893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5aaa4-e2aa-4b29-9919-4c036b166c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:50.533690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5aaa4-e2aa-4b29-9919-4c036b166c25 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.534049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5aaa4-e2aa-4b29-9919-4c036b166c25 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.534331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5aaa4-e2aa-4b29-9919-4c036b166c25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.545434 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5aaa4-e2aa-4b29-9919-4c036b166c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:50.546977 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5aaa4-e2aa-4b29-9919-4c036b166c25 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:50.564951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-15c5aaa4-e2aa-4b29-9919-4c036b166c25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:50.566524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 252/491] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:50.568005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e5f33-3b75-4977-a330-7a87b1fae725 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.568444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e5f33-3b75-4977-a330-7a87b1fae725 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.568862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e5f33-3b75-4977-a330-7a87b1fae725 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.571373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 253/492] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:50.572899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e5f33-3b75-4977-a330-7a87b1fae725 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:50.629094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1355c9-e328-4f3f-8d8b-61c86347fb78 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:50.666125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b402e78-c197-4231-a733-1bcf7ab1af77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:50.667190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b402e78-c197-4231-a733-1bcf7ab1af77 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.667613 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b402e78-c197-4231-a733-1bcf7ab1af77 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.668523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b402e78-c197-4231-a733-1bcf7ab1af77 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.678597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b402e78-c197-4231-a733-1bcf7ab1af77 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:50.680891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b402e78-c197-4231-a733-1bcf7ab1af77 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:50.682797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e5f33-3b75-4977-a330-7a87b1fae725 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:50.698837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-2b402e78-c197-4231-a733-1bcf7ab1af77 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 21:35:50.700856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 240/493] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:50.702182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07988ec4-d497-4128-9d07-013052acd25a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.702471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07988ec4-d497-4128-9d07-013052acd25a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.702745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07988ec4-d497-4128-9d07-013052acd25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.720089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc387aad-5387-4b7f-a765-1e38795d0854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:50.721145 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387aad-5387-4b7f-a765-1e38795d0854 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.721685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387aad-5387-4b7f-a765-1e38795d0854 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.722246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc387aad-5387-4b7f-a765-1e38795d0854 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.723277 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc387aad-5387-4b7f-a765-1e38795d0854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:50.723625 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-07988ec4-d497-4128-9d07-013052acd25a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:50.724025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc387aad-5387-4b7f-a765-1e38795d0854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:50.724808 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-07988ec4-d497-4128-9d07-013052acd25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:50.726496 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc387aad-5387-4b7f-a765-1e38795d0854 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:50.739754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 254/494] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:50.741043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc387aad-5387-4b7f-a765-1e38795d0854 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:50.813109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 241/495] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:50.820278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07988ec4-d497-4128-9d07-013052acd25a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:50.867874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc387aad-5387-4b7f-a765-1e38795d0854 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:50.911885 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75d745-815d-4d1c-97ca-96985a495e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:50.912479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d745-815d-4d1c-97ca-96985a495e52 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.912759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d745-815d-4d1c-97ca-96985a495e52 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.913028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75d745-815d-4d1c-97ca-96985a495e52 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.914457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75d745-815d-4d1c-97ca-96985a495e52 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:50.915139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75d745-815d-4d1c-97ca-96985a495e52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:50.916919 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75d745-815d-4d1c-97ca-96985a495e52 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:50.938545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07988ec4-d497-4128-9d07-013052acd25a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:50.963734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 255/496] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Feb 28 21:35:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:50.965052 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75d745-815d-4d1c-97ca-96985a495e52 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:50.985624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477ca0f-57f4-4de0-8e41-34ac67cce26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:50.986457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477ca0f-57f4-4de0-8e41-34ac67cce26c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:50.986734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477ca0f-57f4-4de0-8e41-34ac67cce26c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:50.987005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477ca0f-57f4-4de0-8e41-34ac67cce26c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:50.996960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477ca0f-57f4-4de0-8e41-34ac67cce26c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:50.999120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477ca0f-57f4-4de0-8e41-34ac67cce26c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:51.015419 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-8477ca0f-57f4-4de0-8e41-34ac67cce26c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 21:35:51.017178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 242/497] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Feb 28 21:35:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:51.018223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477ca0f-57f4-4de0-8e41-34ac67cce26c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:51.071606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75d745-815d-4d1c-97ca-96985a495e52 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:51.105518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdf5d5-3373-4087-888f-e761a8eb967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:51.106337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf5d5-3373-4087-888f-e761a8eb967b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.106616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf5d5-3373-4087-888f-e761a8eb967b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.106888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdf5d5-3373-4087-888f-e761a8eb967b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.117431 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdf5d5-3373-4087-888f-e761a8eb967b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:51.122266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477ca0f-57f4-4de0-8e41-34ac67cce26c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:51.124518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a5cdf5d5-3373-4087-888f-e761a8eb967b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:35:51.125733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 256/498] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:35:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:51.127170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec85198-6bdc-4104-a4a4-89f9497752f1 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.127452 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec85198-6bdc-4104-a4a4-89f9497752f1 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.127723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec85198-6bdc-4104-a4a4-89f9497752f1 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.133624 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 257/499] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:51.134703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec85198-6bdc-4104-a4a4-89f9497752f1 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:51.158259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08f046-5e96-487b-b5a1-7b63e978ce3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:51.159223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08f046-5e96-487b-b5a1-7b63e978ce3a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.159497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08f046-5e96-487b-b5a1-7b63e978ce3a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.159768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08f046-5e96-487b-b5a1-7b63e978ce3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.228719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08f046-5e96-487b-b5a1-7b63e978ce3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:51.230126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08f046-5e96-487b-b5a1-7b63e978ce3a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:51.234261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec85198-6bdc-4104-a4a4-89f9497752f1 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:51.266803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6a29d-d129-49b2-84cf-0386fad80633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:51.267476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6a29d-d129-49b2-84cf-0386fad80633 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.267767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6a29d-d129-49b2-84cf-0386fad80633 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.268033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6a29d-d129-49b2-84cf-0386fad80633 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.268870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6a29d-d129-49b2-84cf-0386fad80633 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:51.269173 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6a29d-d129-49b2-84cf-0386fad80633 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:51.270642 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6a29d-d129-49b2-84cf-0386fad80633 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:51.288475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 258/500] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Feb 28 21:35:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:51.289519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6a29d-d129-49b2-84cf-0386fad80633 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:51.339756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 243/501] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:51.339756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddd2cf-9f70-4394-b3cb-f00b31a152aa None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.339756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddd2cf-9f70-4394-b3cb-f00b31a152aa None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.339756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddd2cf-9f70-4394-b3cb-f00b31a152aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.353152 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-e7ddd2cf-9f70-4394-b3cb-f00b31a152aa None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:51.354356 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e7ddd2cf-9f70-4394-b3cb-f00b31a152aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:51.384315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6a29d-d129-49b2-84cf-0386fad80633 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:51.417430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 244/502] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:51.417700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6ed36-2849-40c8-ad2c-15921d4d8204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:51.418285 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddd2cf-9f70-4394-b3cb-f00b31a152aa None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:51.418387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6ed36-2849-40c8-ad2c-15921d4d8204 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.418628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6ed36-2849-40c8-ad2c-15921d4d8204 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.418905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6ed36-2849-40c8-ad2c-15921d4d8204 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.419647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6ed36-2849-40c8-ad2c-15921d4d8204 None admin] RBAC: Adding query filter params (name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:51.419954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6ed36-2849-40c8-ad2c-15921d4d8204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:51.421336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6ed36-2849-40c8-ad2c-15921d4d8204 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:51.429771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 259/503] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:35:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:51.431056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86683028-975c-42d2-95e6-387a6bf433d0 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.431343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86683028-975c-42d2-95e6-387a6bf433d0 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.431618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86683028-975c-42d2-95e6-387a6bf433d0 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.433240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 260/504] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:51.433925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86683028-975c-42d2-95e6-387a6bf433d0 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:51.515151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddd2cf-9f70-4394-b3cb-f00b31a152aa None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:51.530124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86683028-975c-42d2-95e6-387a6bf433d0 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:51.546385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5ba55-b5f5-466b-bc32-d36ab7720f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:51.547020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5ba55-b5f5-466b-bc32-d36ab7720f11 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.547294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5ba55-b5f5-466b-bc32-d36ab7720f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.547561 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5ba55-b5f5-466b-bc32-d36ab7720f11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.561470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e9d45-bae6-406d-9705-f4c2e13fea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:51.562281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9d45-bae6-406d-9705-f4c2e13fea69 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.562559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9d45-bae6-406d-9705-f4c2e13fea69 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.562829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9d45-bae6-406d-9705-f4c2e13fea69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.573497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e9d45-bae6-406d-9705-f4c2e13fea69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:51.574977 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e9d45-bae6-406d-9705-f4c2e13fea69 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:51.591314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-fd9e9d45-bae6-406d-9705-f4c2e13fea69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:51.592482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 261/505] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:51.593238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e9d45-bae6-406d-9705-f4c2e13fea69 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:51.611318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5ba55-b5f5-466b-bc32-d36ab7720f11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:51.612776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5ba55-b5f5-466b-bc32-d36ab7720f11 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:51.685561 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e9d45-bae6-406d-9705-f4c2e13fea69 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:51.705872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 245/506] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:51.707182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68cbe8-ccc9-4457-8e73-c2fb212bec7d None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.707466 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68cbe8-ccc9-4457-8e73-c2fb212bec7d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.707739 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68cbe8-ccc9-4457-8e73-c2fb212bec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.721328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b85c3-8e3c-4ff3-a2c1-d0b371fc7bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:51.722141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b85c3-8e3c-4ff3-a2c1-d0b371fc7bb9 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.722425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b85c3-8e3c-4ff3-a2c1-d0b371fc7bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.722695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b85c3-8e3c-4ff3-a2c1-d0b371fc7bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.723203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6e68cbe8-ccc9-4457-8e73-c2fb212bec7d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:51.724403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6e68cbe8-ccc9-4457-8e73-c2fb212bec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:51.733442 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b85c3-8e3c-4ff3-a2c1-d0b371fc7bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:51.734902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b85c3-8e3c-4ff3-a2c1-d0b371fc7bb9 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:51.751689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-f70b85c3-8e3c-4ff3-a2c1-d0b371fc7bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:51.759886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 262/507] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:51.759886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b85c3-8e3c-4ff3-a2c1-d0b371fc7bb9 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:51.790211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 246/508] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:51.790829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68cbe8-ccc9-4457-8e73-c2fb212bec7d None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:51.850859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b85c3-8e3c-4ff3-a2c1-d0b371fc7bb9 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:51.884663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68cbe8-ccc9-4457-8e73-c2fb212bec7d None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:51.885053 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87dfb9-e2f7-4cce-b932-3b881f69f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:51.885839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87dfb9-e2f7-4cce-b932-3b881f69f274 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.886154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87dfb9-e2f7-4cce-b932-3b881f69f274 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.886422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87dfb9-e2f7-4cce-b932-3b881f69f274 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.896235 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87dfb9-e2f7-4cce-b932-3b881f69f274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:51.903698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-9e87dfb9-e2f7-4cce-b932-3b881f69f274 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:35:51.904863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 263/509] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:35:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:51.905614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87dfb9-e2f7-4cce-b932-3b881f69f274 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:51.922571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bee9e-76b1-4291-921e-31a951ed5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:51.923234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bee9e-76b1-4291-921e-31a951ed5f84 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:51.923507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bee9e-76b1-4291-921e-31a951ed5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:51.923782 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bee9e-76b1-4291-921e-31a951ed5f84 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:51.924495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bee9e-76b1-4291-921e-31a951ed5f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:51.924793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bee9e-76b1-4291-921e-31a951ed5f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:51.926182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bee9e-76b1-4291-921e-31a951ed5f84 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:51.936939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 247/510] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:51.937714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bee9e-76b1-4291-921e-31a951ed5f84 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.000385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87dfb9-e2f7-4cce-b932-3b881f69f274 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.030787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bee9e-76b1-4291-921e-31a951ed5f84 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.032816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366c124-213a-4723-b129-18df6405da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.033602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366c124-213a-4723-b129-18df6405da4d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.033883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366c124-213a-4723-b129-18df6405da4d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.034193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366c124-213a-4723-b129-18df6405da4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.045179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366c124-213a-4723-b129-18df6405da4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.046617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366c124-213a-4723-b129-18df6405da4d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.062695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f959b-933d-4c3d-9907-343c0b29656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.062844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-2366c124-213a-4723-b129-18df6405da4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:52.063352 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f959b-933d-4c3d-9907-343c0b29656a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.063634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f959b-933d-4c3d-9907-343c0b29656a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.063872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 264/511] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:52.063987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f959b-933d-4c3d-9907-343c0b29656a None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.064617 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f959b-933d-4c3d-9907-343c0b29656a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:52.064714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366c124-213a-4723-b129-18df6405da4d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.065005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f959b-933d-4c3d-9907-343c0b29656a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.066305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f959b-933d-4c3d-9907-343c0b29656a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.077917 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 248/512] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:52.078745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f959b-933d-4c3d-9907-343c0b29656a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.159961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366c124-213a-4723-b129-18df6405da4d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.172331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f959b-933d-4c3d-9907-343c0b29656a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.191703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a6657-eda3-4337-9c65-94a443ef1983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.192480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a6657-eda3-4337-9c65-94a443ef1983 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.192755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a6657-eda3-4337-9c65-94a443ef1983 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.193021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a6657-eda3-4337-9c65-94a443ef1983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.203981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b770-db55-4f50-9a3b-76544d717669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.204114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a6657-eda3-4337-9c65-94a443ef1983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.204636 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b770-db55-4f50-9a3b-76544d717669 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.204915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b770-db55-4f50-9a3b-76544d717669 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.205190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b770-db55-4f50-9a3b-76544d717669 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.205512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a6657-eda3-4337-9c65-94a443ef1983 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.205927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b770-db55-4f50-9a3b-76544d717669 None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:52.206260 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b770-db55-4f50-9a3b-76544d717669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.207723 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b770-db55-4f50-9a3b-76544d717669 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.215972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 249/513] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:52.216752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b770-db55-4f50-9a3b-76544d717669 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.221822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-e47a6657-eda3-4337-9c65-94a443ef1983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:52.224964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 265/514] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:52.224964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a6657-eda3-4337-9c65-94a443ef1983 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.311258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b770-db55-4f50-9a3b-76544d717669 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.317935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a6657-eda3-4337-9c65-94a443ef1983 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.342450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c535ac-7bae-49ca-963f-91e7a3c70dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.343235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c535ac-7bae-49ca-963f-91e7a3c70dbb None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.343514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c535ac-7bae-49ca-963f-91e7a3c70dbb None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.343790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c535ac-7bae-49ca-963f-91e7a3c70dbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.350380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c535ac-7bae-49ca-963f-91e7a3c70dbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.352422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c535ac-7bae-49ca-963f-91e7a3c70dbb None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.352699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ce7a6-3c1a-4dc9-8d09-fdcdfdbd75fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.353351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ce7a6-3c1a-4dc9-8d09-fdcdfdbd75fc None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.353631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ce7a6-3c1a-4dc9-8d09-fdcdfdbd75fc None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.353909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ce7a6-3c1a-4dc9-8d09-fdcdfdbd75fc None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.354684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ce7a6-3c1a-4dc9-8d09-fdcdfdbd75fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:52.354988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ce7a6-3c1a-4dc9-8d09-fdcdfdbd75fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.356360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ce7a6-3c1a-4dc9-8d09-fdcdfdbd75fc None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.367169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-32c535ac-7bae-49ca-963f-91e7a3c70dbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:35:52.368227 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 266/515] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:52.373086 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 250/516] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:52.373207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ce7a6-3c1a-4dc9-8d09-fdcdfdbd75fc None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.373279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c535ac-7bae-49ca-963f-91e7a3c70dbb None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.463863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ce7a6-3c1a-4dc9-8d09-fdcdfdbd75fc None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.464394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c535ac-7bae-49ca-963f-91e7a3c70dbb None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.495355 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347b4aa-2b80-412c-b918-3d9ec6d9a75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.496131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347b4aa-2b80-412c-b918-3d9ec6d9a75e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.496349 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066400e3-c86c-4475-9aaf-c823eaef9828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.496465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347b4aa-2b80-412c-b918-3d9ec6d9a75e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.496655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347b4aa-2b80-412c-b918-3d9ec6d9a75e None admin] PATH_INFO: `/v3/users/glance` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.497133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066400e3-c86c-4475-9aaf-c823eaef9828 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.497409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066400e3-c86c-4475-9aaf-c823eaef9828 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.497677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066400e3-c86c-4475-9aaf-c823eaef9828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.503428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347b4aa-2b80-412c-b918-3d9ec6d9a75e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.504833 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347b4aa-2b80-412c-b918-3d9ec6d9a75e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.507979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066400e3-c86c-4475-9aaf-c823eaef9828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.509723 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066400e3-c86c-4475-9aaf-c823eaef9828 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.519437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a347b4aa-2b80-412c-b918-3d9ec6d9a75e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 21:35:52.520584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 267/517] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:52.521334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347b4aa-2b80-412c-b918-3d9ec6d9a75e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.526709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-066400e3-c86c-4475-9aaf-c823eaef9828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:52.532155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 251/518] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:52.532155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066400e3-c86c-4475-9aaf-c823eaef9828 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.613687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347b4aa-2b80-412c-b918-3d9ec6d9a75e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.620955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066400e3-c86c-4475-9aaf-c823eaef9828 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.646582 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1683294-b369-46e4-8e31-e788fd2a5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.647319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1683294-b369-46e4-8e31-e788fd2a5065 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.647599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1683294-b369-46e4-8e31-e788fd2a5065 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.648008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1683294-b369-46e4-8e31-e788fd2a5065 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.648821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1683294-b369-46e4-8e31-e788fd2a5065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:52.649121 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1683294-b369-46e4-8e31-e788fd2a5065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.650505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1683294-b369-46e4-8e31-e788fd2a5065 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.653047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1525e8-b852-4820-8598-06b9e3294cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.653823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1525e8-b852-4820-8598-06b9e3294cdb None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.654135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1525e8-b852-4820-8598-06b9e3294cdb None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.654409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1525e8-b852-4820-8598-06b9e3294cdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.660840 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1525e8-b852-4820-8598-06b9e3294cdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.661221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 268/519] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:52.662050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1683294-b369-46e4-8e31-e788fd2a5065 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.662299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1525e8-b852-4820-8598-06b9e3294cdb None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.675281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-4b1525e8-b852-4820-8598-06b9e3294cdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:35:52.676448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 252/520] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:52.677205 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1525e8-b852-4820-8598-06b9e3294cdb None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.753267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1683294-b369-46e4-8e31-e788fd2a5065 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.770640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1525e8-b852-4820-8598-06b9e3294cdb None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.784634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95717f9b-e80f-4952-ab09-31b3093da93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.785275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95717f9b-e80f-4952-ab09-31b3093da93a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.785554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95717f9b-e80f-4952-ab09-31b3093da93a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.785818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95717f9b-e80f-4952-ab09-31b3093da93a None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.786619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95717f9b-e80f-4952-ab09-31b3093da93a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:52.786924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95717f9b-e80f-4952-ab09-31b3093da93a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.788361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95717f9b-e80f-4952-ab09-31b3093da93a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.801602 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fca905-15ec-4e3a-a770-e1d2aa5b7ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.802279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fca905-15ec-4e3a-a770-e1d2aa5b7ef7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.802557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fca905-15ec-4e3a-a770-e1d2aa5b7ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.802826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fca905-15ec-4e3a-a770-e1d2aa5b7ef7 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.803644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fca905-15ec-4e3a-a770-e1d2aa5b7ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:52.804477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fca905-15ec-4e3a-a770-e1d2aa5b7ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.805868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 269/521] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:52.806041 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fca905-15ec-4e3a-a770-e1d2aa5b7ef7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.806476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95717f9b-e80f-4952-ab09-31b3093da93a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.841818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 253/522] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:52.842685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fca905-15ec-4e3a-a770-e1d2aa5b7ef7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.927617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95717f9b-e80f-4952-ab09-31b3093da93a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.959577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fca905-15ec-4e3a-a770-e1d2aa5b7ef7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:52.959754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaaf21-9eed-4f91-90a3-cd2c3593c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.961188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaaf21-9eed-4f91-90a3-cd2c3593c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.961548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaaf21-9eed-4f91-90a3-cd2c3593c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.961824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaaf21-9eed-4f91-90a3-cd2c3593c3c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.962569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaaf21-9eed-4f91-90a3-cd2c3593c3c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:52.962875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaaf21-9eed-4f91-90a3-cd2c3593c3c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.964245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaaf21-9eed-4f91-90a3-cd2c3593c3c0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:52.975039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 270/523] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:52.976366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaaf21-9eed-4f91-90a3-cd2c3593c3c0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:52.993037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8604d07-809a-448d-b81c-c4820ad2a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:52.993699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8604d07-809a-448d-b81c-c4820ad2a01b None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:52.993976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8604d07-809a-448d-b81c-c4820ad2a01b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:52.994275 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8604d07-809a-448d-b81c-c4820ad2a01b None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:52.994966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8604d07-809a-448d-b81c-c4820ad2a01b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:52.996383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8604d07-809a-448d-b81c-c4820ad2a01b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:53.065917 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 254/524] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:35:52 2022] POST /identity/v3/users => generated 247 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:35:53.066758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8604d07-809a-448d-b81c-c4820ad2a01b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:53.081236 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaaf21-9eed-4f91-90a3-cd2c3593c3c0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:53.117179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127ded-36d9-4f4b-bd87-dfe564dd083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:53.117957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127ded-36d9-4f4b-bd87-dfe564dd083e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:53.118258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127ded-36d9-4f4b-bd87-dfe564dd083e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:53.118537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127ded-36d9-4f4b-bd87-dfe564dd083e None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:53.119348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127ded-36d9-4f4b-bd87-dfe564dd083e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:53.119660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127ded-36d9-4f4b-bd87-dfe564dd083e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:53.121147 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127ded-36d9-4f4b-bd87-dfe564dd083e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:53.136095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 271/525] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:35:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:53.136978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127ded-36d9-4f4b-bd87-dfe564dd083e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:53.181558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8604d07-809a-448d-b81c-c4820ad2a01b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:53.217622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6c32d-bf8d-49d4-a495-bb0621fc412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:53.218330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6c32d-bf8d-49d4-a495-bb0621fc412b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:53.218618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6c32d-bf8d-49d4-a495-bb0621fc412b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:53.218886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6c32d-bf8d-49d4-a495-bb0621fc412b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:53.219742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6c32d-bf8d-49d4-a495-bb0621fc412b None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=ee8e7d47becf4c03967848eda8c311be) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:53.220052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6c32d-bf8d-49d4-a495-bb0621fc412b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:53.221530 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6c32d-bf8d-49d4-a495-bb0621fc412b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:53.228062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 255/526] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:53 2022] GET /identity/v3/role_assignments?user.id=ee8e7d47becf4c03967848eda8c311be&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:53.228907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6c32d-bf8d-49d4-a495-bb0621fc412b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:53.265262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127ded-36d9-4f4b-bd87-dfe564dd083e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:53.314923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb45c39-75a1-4d5c-9240-2c9ea1e845b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:53.315584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb45c39-75a1-4d5c-9240-2c9ea1e845b3 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:53.315858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb45c39-75a1-4d5c-9240-2c9ea1e845b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:53.316127 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb45c39-75a1-4d5c-9240-2c9ea1e845b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:53.349744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6c32d-bf8d-49d4-a495-bb0621fc412b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:53.393039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41355a9-f2ab-404c-a478-ea00835ac1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:53.394374 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41355a9-f2ab-404c-a478-ea00835ac1db None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:53.394886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41355a9-f2ab-404c-a478-ea00835ac1db None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:53.395166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41355a9-f2ab-404c-a478-ea00835ac1db None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:53.401979 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb45c39-75a1-4d5c-9240-2c9ea1e845b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:53.403756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb45c39-75a1-4d5c-9240-2c9ea1e845b3 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:53.405527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41355a9-f2ab-404c-a478-ea00835ac1db None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:53.408147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41355a9-f2ab-404c-a478-ea00835ac1db None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:53.423787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-a41355a9-f2ab-404c-a478-ea00835ac1db None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 21:35:53.429552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 256/527] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:35:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:53.432375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41355a9-f2ab-404c-a478-ea00835ac1db None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:53.526095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 272/528] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:53.526999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb45c39-75a1-4d5c-9240-2c9ea1e845b3 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:53.551886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41355a9-f2ab-404c-a478-ea00835ac1db None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:53.586162 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fb8d2-56a2-479b-bf63-61c223c1c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:53.586897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fb8d2-56a2-479b-bf63-61c223c1c717 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:53.587179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fb8d2-56a2-479b-bf63-61c223c1c717 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:53.587450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fb8d2-56a2-479b-bf63-61c223c1c717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:53.588269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fb8d2-56a2-479b-bf63-61c223c1c717 None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=8182c282a5754f05b4bb6bb7057fa7ab) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:53.588573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fb8d2-56a2-479b-bf63-61c223c1c717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:53.590001 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fb8d2-56a2-479b-bf63-61c223c1c717 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:53.595408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 257/529] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:53 2022] GET /identity/v3/role_assignments?user.id=8182c282a5754f05b4bb6bb7057fa7ab&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:53.596252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fb8d2-56a2-479b-bf63-61c223c1c717 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:53.660457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb45c39-75a1-4d5c-9240-2c9ea1e845b3 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:53.699038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc532f49-4e12-43bb-a139-5ad29f92eb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:53.699639 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc532f49-4e12-43bb-a139-5ad29f92eb9f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:53.699922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc532f49-4e12-43bb-a139-5ad29f92eb9f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:53.700198 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc532f49-4e12-43bb-a139-5ad29f92eb9f None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:53.701044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc532f49-4e12-43bb-a139-5ad29f92eb9f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:53.701350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc532f49-4e12-43bb-a139-5ad29f92eb9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:53.703096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc532f49-4e12-43bb-a139-5ad29f92eb9f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:53.726316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 273/530] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Feb 28 21:35:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:53.735324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc532f49-4e12-43bb-a139-5ad29f92eb9f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:53.753847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fb8d2-56a2-479b-bf63-61c223c1c717 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:53.825077 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44610303-0a40-4045-9d2f-2cf97ecb5276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:53.825886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44610303-0a40-4045-9d2f-2cf97ecb5276 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:53.826195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44610303-0a40-4045-9d2f-2cf97ecb5276 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:53.826461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44610303-0a40-4045-9d2f-2cf97ecb5276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:53.844526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44610303-0a40-4045-9d2f-2cf97ecb5276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:53.846027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44610303-0a40-4045-9d2f-2cf97ecb5276 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:53.873703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-44610303-0a40-4045-9d2f-2cf97ecb5276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:53.875557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 258/531] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:53.883702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44610303-0a40-4045-9d2f-2cf97ecb5276 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:53.939939 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc532f49-4e12-43bb-a139-5ad29f92eb9f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:54.011303 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44610303-0a40-4045-9d2f-2cf97ecb5276 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:54.038859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef36c0d-cb8a-4a0a-8746-615b32554e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:54.039585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36c0d-cb8a-4a0a-8746-615b32554e07 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:54.039875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36c0d-cb8a-4a0a-8746-615b32554e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:54.040158 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36c0d-cb8a-4a0a-8746-615b32554e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:54.045957 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725a82c-dfc3-406f-be2c-3dbfc8e87020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:54.046648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725a82c-dfc3-406f-be2c-3dbfc8e87020 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:54.046922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725a82c-dfc3-406f-be2c-3dbfc8e87020 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:54.047191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725a82c-dfc3-406f-be2c-3dbfc8e87020 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:54.047912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725a82c-dfc3-406f-be2c-3dbfc8e87020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:54.048212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725a82c-dfc3-406f-be2c-3dbfc8e87020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:54.049580 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725a82c-dfc3-406f-be2c-3dbfc8e87020 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:54.066945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 259/532] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:54.068213 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725a82c-dfc3-406f-be2c-3dbfc8e87020 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:54.166061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725a82c-dfc3-406f-be2c-3dbfc8e87020 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:54.203104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1db4b1-5ecd-46ba-a13c-87563e7d34ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:54.203886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db4b1-5ecd-46ba-a13c-87563e7d34ae None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:54.204155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db4b1-5ecd-46ba-a13c-87563e7d34ae None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:54.204422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1db4b1-5ecd-46ba-a13c-87563e7d34ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:54.208741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef36c0d-cb8a-4a0a-8746-615b32554e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:54.210735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef36c0d-cb8a-4a0a-8746-615b32554e07 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:54.216655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1db4b1-5ecd-46ba-a13c-87563e7d34ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:54.218121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1db4b1-5ecd-46ba-a13c-87563e7d34ae None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:54.238642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-3b1db4b1-5ecd-46ba-a13c-87563e7d34ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:35:54.239853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 260/533] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:54.250956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1db4b1-5ecd-46ba-a13c-87563e7d34ae None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:54.344601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 274/534] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:54.351513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef36c0d-cb8a-4a0a-8746-615b32554e07 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:54.400929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1db4b1-5ecd-46ba-a13c-87563e7d34ae None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:54.435213 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779a8b-ffeb-4029-988e-119b7b13e019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:54.435869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779a8b-ffeb-4029-988e-119b7b13e019 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:54.438031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779a8b-ffeb-4029-988e-119b7b13e019 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:54.438031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779a8b-ffeb-4029-988e-119b7b13e019 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:54.438031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779a8b-ffeb-4029-988e-119b7b13e019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:54.438031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779a8b-ffeb-4029-988e-119b7b13e019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:54.439049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779a8b-ffeb-4029-988e-119b7b13e019 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:54.456775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 261/535] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:35:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:54.463259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779a8b-ffeb-4029-988e-119b7b13e019 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:54.535295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef36c0d-cb8a-4a0a-8746-615b32554e07 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:54.581476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fed1c7-271b-4c9c-a13f-6be3a6998ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:54.582600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fed1c7-271b-4c9c-a13f-6be3a6998ab7 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:54.583015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fed1c7-271b-4c9c-a13f-6be3a6998ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:54.583447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fed1c7-271b-4c9c-a13f-6be3a6998ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:54.597605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779a8b-ffeb-4029-988e-119b7b13e019 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:54.608710 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fed1c7-271b-4c9c-a13f-6be3a6998ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:54.610216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fed1c7-271b-4c9c-a13f-6be3a6998ab7 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:54.635266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b52755-b158-42ed-8ee9-b3b8548ff8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:54.636150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52755-b158-42ed-8ee9-b3b8548ff8a5 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:54.636552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52755-b158-42ed-8ee9-b3b8548ff8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:54.636942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b52755-b158-42ed-8ee9-b3b8548ff8a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:54.637876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b52755-b158-42ed-8ee9-b3b8548ff8a5 None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=500eaf6aadff441ca1e535443e1d8c03) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:54.638328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b52755-b158-42ed-8ee9-b3b8548ff8a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:54.639908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b52755-b158-42ed-8ee9-b3b8548ff8a5 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:54.643386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-c1fed1c7-271b-4c9c-a13f-6be3a6998ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:54.645018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 275/536] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:54.646007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 262/537] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:54 2022] GET /identity/v3/role_assignments?user.id=500eaf6aadff441ca1e535443e1d8c03&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:54.658827 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fed1c7-271b-4c9c-a13f-6be3a6998ab7 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:54.808726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fed1c7-271b-4c9c-a13f-6be3a6998ab7 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:54.851445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be023-97af-4e5e-9e84-385d689eddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:54.852131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be023-97af-4e5e-9e84-385d689eddeb None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:54.852422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be023-97af-4e5e-9e84-385d689eddeb None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:54.852696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be023-97af-4e5e-9e84-385d689eddeb None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:54.853430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633be023-97af-4e5e-9e84-385d689eddeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:54.853735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633be023-97af-4e5e-9e84-385d689eddeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:54.855141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633be023-97af-4e5e-9e84-385d689eddeb None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:54.868789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 276/538] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:54.873916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b52755-b158-42ed-8ee9-b3b8548ff8a5 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:55.010736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b52755-b158-42ed-8ee9-b3b8548ff8a5 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:55.062177 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd159bd-9025-448f-8fe8-f4bb6c5759a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:55.063270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd159bd-9025-448f-8fe8-f4bb6c5759a2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:55.063726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd159bd-9025-448f-8fe8-f4bb6c5759a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:55.064198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd159bd-9025-448f-8fe8-f4bb6c5759a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:55.073752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd159bd-9025-448f-8fe8-f4bb6c5759a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:55.075494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd159bd-9025-448f-8fe8-f4bb6c5759a2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:55.101719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-8dd159bd-9025-448f-8fe8-f4bb6c5759a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:35:55.103256 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 263/539] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:55.108910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be023-97af-4e5e-9e84-385d689eddeb None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:55.258192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be023-97af-4e5e-9e84-385d689eddeb None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:55.299815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64bae8-bc60-425d-a504-0f25a1ff17fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:55.300472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64bae8-bc60-425d-a504-0f25a1ff17fa None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:55.300751 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64bae8-bc60-425d-a504-0f25a1ff17fa None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:55.301020 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64bae8-bc60-425d-a504-0f25a1ff17fa None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:55.301804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64bae8-bc60-425d-a504-0f25a1ff17fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:55.302134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64bae8-bc60-425d-a504-0f25a1ff17fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:55.303559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64bae8-bc60-425d-a504-0f25a1ff17fa None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:55.320424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 277/540] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:35:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:55.326335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd159bd-9025-448f-8fe8-f4bb6c5759a2 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:55.452531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd159bd-9025-448f-8fe8-f4bb6c5759a2 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:55.488179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54713447-1e5d-426e-8005-720798306b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:55.488838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54713447-1e5d-426e-8005-720798306b4e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:55.489114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54713447-1e5d-426e-8005-720798306b4e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:55.489389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54713447-1e5d-426e-8005-720798306b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:55.490244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54713447-1e5d-426e-8005-720798306b4e None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=b4664710493b462bafae3908c582e9bc) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:55.490551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54713447-1e5d-426e-8005-720798306b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:55.492243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54713447-1e5d-426e-8005-720798306b4e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:55.498265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 264/541] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:55 2022] GET /identity/v3/role_assignments?user.id=b4664710493b462bafae3908c582e9bc&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:55.759699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2770b-559a-43df-ab02-06849cac44e8 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:55.759876 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2770b-559a-43df-ab02-06849cac44e8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:55.760163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2770b-559a-43df-ab02-06849cac44e8 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:55.762003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 278/542] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:55.767731 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046d046-5cc3-47c0-88cb-ca7931aa417c None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:55.768044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046d046-5cc3-47c0-88cb-ca7931aa417c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:55.768286 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046d046-5cc3-47c0-88cb-ca7931aa417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:55.791061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-2046d046-5cc3-47c0-88cb-ca7931aa417c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:55.792289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2046d046-5cc3-47c0-88cb-ca7931aa417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:55.874817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 265/543] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:55.901839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2770b-559a-43df-ab02-06849cac44e8 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:55.989482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcddab9-bc90-4c7e-b24e-0f00f67b2873 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:55.989760 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcddab9-bc90-4c7e-b24e-0f00f67b2873 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:55.990071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcddab9-bc90-4c7e-b24e-0f00f67b2873 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:55.992622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 266/544] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:35:55.997892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e6afb-1570-424d-95a1-7b131ee8949a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:55.998194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e6afb-1570-424d-95a1-7b131ee8949a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:55.998471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e6afb-1570-424d-95a1-7b131ee8949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:56.010768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2770b-559a-43df-ab02-06849cac44e8 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:56.015817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-779e6afb-1570-424d-95a1-7b131ee8949a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:56.016996 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-779e6afb-1570-424d-95a1-7b131ee8949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:56.075650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db992-abd0-4058-b368-9e4a4cf8b55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:56.076460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db992-abd0-4058-b368-9e4a4cf8b55d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:56.076742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db992-abd0-4058-b368-9e4a4cf8b55d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:56.077016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5db992-abd0-4058-b368-9e4a4cf8b55d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:56.088149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 267/545] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:56.110972 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5db992-abd0-4058-b368-9e4a4cf8b55d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:56.112427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e6afb-1570-424d-95a1-7b131ee8949a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:56.118552 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-1a5db992-abd0-4058-b368-9e4a4cf8b55d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:35:56.120158 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 279/546] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:56.131195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db992-abd0-4058-b368-9e4a4cf8b55d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:56.276580 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e6afb-1570-424d-95a1-7b131ee8949a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:56.311373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5db992-abd0-4058-b368-9e4a4cf8b55d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:56.337166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e40c5-0a00-4037-b7e3-44482a6ae7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:56.338323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e40c5-0a00-4037-b7e3-44482a6ae7f8 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:56.338833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e40c5-0a00-4037-b7e3-44482a6ae7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:56.339309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e40c5-0a00-4037-b7e3-44482a6ae7f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:56.357046 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e40c5-0a00-4037-b7e3-44482a6ae7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:56.365726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-256e40c5-0a00-4037-b7e3-44482a6ae7f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:35:56.374085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 268/547] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:56.374640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb489c-d20d-45b8-b62a-ecc2103fada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:56.375544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb489c-d20d-45b8-b62a-ecc2103fada3 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:56.376024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb489c-d20d-45b8-b62a-ecc2103fada3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:56.376495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb489c-d20d-45b8-b62a-ecc2103fada3 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:56.377793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb489c-d20d-45b8-b62a-ecc2103fada3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:56.378310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e40c5-0a00-4037-b7e3-44482a6ae7f8 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:56.378555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb489c-d20d-45b8-b62a-ecc2103fada3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:56.380185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb489c-d20d-45b8-b62a-ecc2103fada3 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:56.389931 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 280/548] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:56.395599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb489c-d20d-45b8-b62a-ecc2103fada3 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:56.499929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb489c-d20d-45b8-b62a-ecc2103fada3 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:56.535082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241bbaf-d151-48b5-872d-ac696d6f0a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:56.536205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bbaf-d151-48b5-872d-ac696d6f0a29 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:56.536689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bbaf-d151-48b5-872d-ac696d6f0a29 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:56.537160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bbaf-d151-48b5-872d-ac696d6f0a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:56.549248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241bbaf-d151-48b5-872d-ac696d6f0a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:56.551004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241bbaf-d151-48b5-872d-ac696d6f0a29 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:56.568312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-9241bbaf-d151-48b5-872d-ac696d6f0a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:56.574278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 281/549] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:35:56.575710 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241bbaf-d151-48b5-872d-ac696d6f0a29 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:56.623750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e40c5-0a00-4037-b7e3-44482a6ae7f8 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:56.673339 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f0e2a-6ebe-4394-a471-e87b0704a01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:56.674454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0e2a-6ebe-4394-a471-e87b0704a01f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:56.674818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0e2a-6ebe-4394-a471-e87b0704a01f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:56.675315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f0e2a-6ebe-4394-a471-e87b0704a01f None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:56.676243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f0e2a-6ebe-4394-a471-e87b0704a01f None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:56.676641 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f0e2a-6ebe-4394-a471-e87b0704a01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:56.678880 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f0e2a-6ebe-4394-a471-e87b0704a01f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:56.683798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241bbaf-d151-48b5-872d-ac696d6f0a29 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:56.697638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 269/550] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:56.697638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c610-1001-4e4a-b535-1a2439ca6b51 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:56.697638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c610-1001-4e4a-b535-1a2439ca6b51 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:56.697638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c610-1001-4e4a-b535-1a2439ca6b51 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:56.697638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 270/551] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:56.697638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c610-1001-4e4a-b535-1a2439ca6b51 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:56.733798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4636af-e883-4980-88ec-672eca68803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:56.734750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4636af-e883-4980-88ec-672eca68803d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:56.735116 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4636af-e883-4980-88ec-672eca68803d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:56.735419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4636af-e883-4980-88ec-672eca68803d None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:56.736253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4636af-e883-4980-88ec-672eca68803d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:56.736575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4636af-e883-4980-88ec-672eca68803d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:56.737940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4636af-e883-4980-88ec-672eca68803d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:56.758079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 282/552] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:35:56.760004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d490e-add4-4751-bb9c-60064e9a0428 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:56.760489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d490e-add4-4751-bb9c-60064e9a0428 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:56.760983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d490e-add4-4751-bb9c-60064e9a0428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:56.786817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-8b3d490e-add4-4751-bb9c-60064e9a0428 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:56.787946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-8b3d490e-add4-4751-bb9c-60064e9a0428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:56.823221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c610-1001-4e4a-b535-1a2439ca6b51 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:56.865745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a122f-c027-4800-8917-82b220d05030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:56.867262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a122f-c027-4800-8917-82b220d05030 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:56.867757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a122f-c027-4800-8917-82b220d05030 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:56.868230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a122f-c027-4800-8917-82b220d05030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:56.877879 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 283/553] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:56.877879 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d490e-add4-4751-bb9c-60064e9a0428 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:56.891201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a122f-c027-4800-8917-82b220d05030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:56.893599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a122f-c027-4800-8917-82b220d05030 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:56.920944 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-200a122f-c027-4800-8917-82b220d05030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:56.926008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 271/554] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:56.927201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a122f-c027-4800-8917-82b220d05030 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:56.981841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d490e-add4-4751-bb9c-60064e9a0428 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.018485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c004e-6942-4d40-adeb-034390f3342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.019676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c004e-6942-4d40-adeb-034390f3342a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.020162 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c004e-6942-4d40-adeb-034390f3342a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.020688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c004e-6942-4d40-adeb-034390f3342a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.030823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c004e-6942-4d40-adeb-034390f3342a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:57.032659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c004e-6942-4d40-adeb-034390f3342a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:57.049788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-653c004e-6942-4d40-adeb-034390f3342a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 21:35:57.051620 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 284/555] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:57.052631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c004e-6942-4d40-adeb-034390f3342a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:57.058918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a122f-c027-4800-8917-82b220d05030 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.100186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fd719-8175-485e-a8cd-6ba0378621bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.101867 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fd719-8175-485e-a8cd-6ba0378621bd None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.102443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fd719-8175-485e-a8cd-6ba0378621bd None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.102939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fd719-8175-485e-a8cd-6ba0378621bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.113302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fd719-8175-485e-a8cd-6ba0378621bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:57.121335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-0a8fd719-8175-485e-a8cd-6ba0378621bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:35:57.127859 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 272/556] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:57.128979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fd719-8175-485e-a8cd-6ba0378621bd None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:57.169134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c004e-6942-4d40-adeb-034390f3342a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.213167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8069c8-b5f8-44a9-90c4-043f107b43b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.213840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8069c8-b5f8-44a9-90c4-043f107b43b0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.214189 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8069c8-b5f8-44a9-90c4-043f107b43b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.214785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8069c8-b5f8-44a9-90c4-043f107b43b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.215538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8069c8-b5f8-44a9-90c4-043f107b43b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:57.215846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8069c8-b5f8-44a9-90c4-043f107b43b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:57.217225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8069c8-b5f8-44a9-90c4-043f107b43b0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:57.234387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 285/557] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:57.234715 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fd719-8175-485e-a8cd-6ba0378621bd None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.235777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8069c8-b5f8-44a9-90c4-043f107b43b0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:57.277280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5ba9e-3242-4324-a4ef-13d1d2b1a787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.277958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5ba9e-3242-4324-a4ef-13d1d2b1a787 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.278265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5ba9e-3242-4324-a4ef-13d1d2b1a787 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.278543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5ba9e-3242-4324-a4ef-13d1d2b1a787 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.279380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5ba9e-3242-4324-a4ef-13d1d2b1a787 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:57.279692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5ba9e-3242-4324-a4ef-13d1d2b1a787 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:57.281526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5ba9e-3242-4324-a4ef-13d1d2b1a787 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:57.304424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 273/558] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:57.305327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5ba9e-3242-4324-a4ef-13d1d2b1a787 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:57.348669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8069c8-b5f8-44a9-90c4-043f107b43b0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.384182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e8403-526c-42e1-a558-4b1b24db0020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.384850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e8403-526c-42e1-a558-4b1b24db0020 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.385129 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e8403-526c-42e1-a558-4b1b24db0020 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.385397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e8403-526c-42e1-a558-4b1b24db0020 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.386166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e8403-526c-42e1-a558-4b1b24db0020 None admin] RBAC: Adding query filter params (name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:57.386468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e8403-526c-42e1-a558-4b1b24db0020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:57.387829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e8403-526c-42e1-a558-4b1b24db0020 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:57.396815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 286/559] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:57.398501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e8403-526c-42e1-a558-4b1b24db0020 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:57.420881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5ba9e-3242-4324-a4ef-13d1d2b1a787 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.453654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e68ad-9f60-44a9-a145-b44f5c645379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.454478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e68ad-9f60-44a9-a145-b44f5c645379 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.454762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e68ad-9f60-44a9-a145-b44f5c645379 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.455034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e68ad-9f60-44a9-a145-b44f5c645379 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.462629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e68ad-9f60-44a9-a145-b44f5c645379 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:57.464072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e68ad-9f60-44a9-a145-b44f5c645379 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:57.479165 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-d62e68ad-9f60-44a9-a145-b44f5c645379 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 21:35:57.480367 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 274/560] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:57.481586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b8409-a236-4d96-9c97-ce1406101c3a None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.481867 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b8409-a236-4d96-9c97-ce1406101c3a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.482167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b8409-a236-4d96-9c97-ce1406101c3a None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.485585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 275/561] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:57.485585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b8409-a236-4d96-9c97-ce1406101c3a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:57.515174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e8403-526c-42e1-a558-4b1b24db0020 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.553910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acc5d4-c2e2-4b8e-bc97-0ba61418b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.554995 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acc5d4-c2e2-4b8e-bc97-0ba61418b821 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.555220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acc5d4-c2e2-4b8e-bc97-0ba61418b821 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.555494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acc5d4-c2e2-4b8e-bc97-0ba61418b821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.567439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acc5d4-c2e2-4b8e-bc97-0ba61418b821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:57.568959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acc5d4-c2e2-4b8e-bc97-0ba61418b821 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:57.587862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-e4acc5d4-c2e2-4b8e-bc97-0ba61418b821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:57.593589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 287/562] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:57.593589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acc5d4-c2e2-4b8e-bc97-0ba61418b821 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:57.594884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b8409-a236-4d96-9c97-ce1406101c3a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.630591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822c67a-f550-44d7-9cc2-4e70b8938673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.632412 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822c67a-f550-44d7-9cc2-4e70b8938673 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.632897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822c67a-f550-44d7-9cc2-4e70b8938673 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.633371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822c67a-f550-44d7-9cc2-4e70b8938673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.643959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822c67a-f550-44d7-9cc2-4e70b8938673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:57.645764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822c67a-f550-44d7-9cc2-4e70b8938673 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:57.663244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-a822c67a-f550-44d7-9cc2-4e70b8938673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:57.664928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 276/563] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:57.666258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb5ae-8e4f-40cd-abc8-327df6fc5f21 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.666644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb5ae-8e4f-40cd-abc8-327df6fc5f21 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.667021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbb5ae-8e4f-40cd-abc8-327df6fc5f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.684271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-4fcbb5ae-8e4f-40cd-abc8-327df6fc5f21 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:57.685594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4fcbb5ae-8e4f-40cd-abc8-327df6fc5f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:57.692245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acc5d4-c2e2-4b8e-bc97-0ba61418b821 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.727439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048e16b-3d01-4dd9-86fb-062499f44c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.728135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e16b-3d01-4dd9-86fb-062499f44c60 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.728408 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e16b-3d01-4dd9-86fb-062499f44c60 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.728679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e16b-3d01-4dd9-86fb-062499f44c60 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.729528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048e16b-3d01-4dd9-86fb-062499f44c60 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:57.730147 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048e16b-3d01-4dd9-86fb-062499f44c60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:57.731488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048e16b-3d01-4dd9-86fb-062499f44c60 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:57.750513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 288/564] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:57.751429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048e16b-3d01-4dd9-86fb-062499f44c60 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:57.760676 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 277/565] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:57.761521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbb5ae-8e4f-40cd-abc8-327df6fc5f21 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:57.857034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048e16b-3d01-4dd9-86fb-062499f44c60 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.862487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbb5ae-8e4f-40cd-abc8-327df6fc5f21 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:57.892076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19c734-b1b7-4889-a85d-471833a6fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.892867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19c734-b1b7-4889-a85d-471833a6fdd1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.893198 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19c734-b1b7-4889-a85d-471833a6fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.893532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19c734-b1b7-4889-a85d-471833a6fdd1 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.894294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19c734-b1b7-4889-a85d-471833a6fdd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:57.894599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19c734-b1b7-4889-a85d-471833a6fdd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:57.895607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12055741-d9a6-4e64-8699-6d4e80b54997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:57.896053 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19c734-b1b7-4889-a85d-471833a6fdd1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:57.896271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12055741-d9a6-4e64-8699-6d4e80b54997 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:57.896547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12055741-d9a6-4e64-8699-6d4e80b54997 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:57.896817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12055741-d9a6-4e64-8699-6d4e80b54997 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:57.898093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12055741-d9a6-4e64-8699-6d4e80b54997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:57.898395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12055741-d9a6-4e64-8699-6d4e80b54997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:57.899748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12055741-d9a6-4e64-8699-6d4e80b54997 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:57.910102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 289/566] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:57.910102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19c734-b1b7-4889-a85d-471833a6fdd1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:57.914138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 278/567] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:57.915159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12055741-d9a6-4e64-8699-6d4e80b54997 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.008437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19c734-b1b7-4889-a85d-471833a6fdd1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.012809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12055741-d9a6-4e64-8699-6d4e80b54997 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.042257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf65a1f-30b2-464f-aa23-aceb6c67d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.042926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf65a1f-30b2-464f-aa23-aceb6c67d200 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.043260 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf65a1f-30b2-464f-aa23-aceb6c67d200 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.043538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf65a1f-30b2-464f-aa23-aceb6c67d200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.046380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc944-a061-49de-9e5e-2f9d5ccd258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.047307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc944-a061-49de-9e5e-2f9d5ccd258f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.047587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc944-a061-49de-9e5e-2f9d5ccd258f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.047856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc944-a061-49de-9e5e-2f9d5ccd258f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.058594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc944-a061-49de-9e5e-2f9d5ccd258f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:58.065596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-b5afc944-a061-49de-9e5e-2f9d5ccd258f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:35:58.072088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 279/568] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:58.072088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc944-a061-49de-9e5e-2f9d5ccd258f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.113396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf65a1f-30b2-464f-aa23-aceb6c67d200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:58.114778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf65a1f-30b2-464f-aa23-aceb6c67d200 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:58.162861 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc944-a061-49de-9e5e-2f9d5ccd258f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.194961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ab907-12a9-41e2-bf40-5776c02e5ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.195749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab907-12a9-41e2-bf40-5776c02e5ef3 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.196030 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab907-12a9-41e2-bf40-5776c02e5ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.196305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ab907-12a9-41e2-bf40-5776c02e5ef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.202888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ab907-12a9-41e2-bf40-5776c02e5ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:58.204347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ab907-12a9-41e2-bf40-5776c02e5ef3 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:58.207955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 290/569] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:35:58.208771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf65a1f-30b2-464f-aa23-aceb6c67d200 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.218158 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-642ab907-12a9-41e2-bf40-5776c02e5ef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:35:58.219364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 280/570] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:58.220107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ab907-12a9-41e2-bf40-5776c02e5ef3 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.309649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf65a1f-30b2-464f-aa23-aceb6c67d200 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.316576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ab907-12a9-41e2-bf40-5776c02e5ef3 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.341153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc3ae3-c455-4868-bcf5-aa73c659763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.341941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc3ae3-c455-4868-bcf5-aa73c659763c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.342255 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc3ae3-c455-4868-bcf5-aa73c659763c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.342520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc3ae3-c455-4868-bcf5-aa73c659763c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.349212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc3ae3-c455-4868-bcf5-aa73c659763c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:58.349323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feee689-2237-4eea-9d73-97aa5a71fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.349880 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee689-2237-4eea-9d73-97aa5a71fc2e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.350191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee689-2237-4eea-9d73-97aa5a71fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.351001 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee689-2237-4eea-9d73-97aa5a71fc2e None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.351208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc3ae3-c455-4868-bcf5-aa73c659763c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:58.352237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feee689-2237-4eea-9d73-97aa5a71fc2e None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:58.352544 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feee689-2237-4eea-9d73-97aa5a71fc2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:58.353906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feee689-2237-4eea-9d73-97aa5a71fc2e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:58.361631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 281/571] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:35:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:58.362893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8837-648e-41e2-8fdd-de6d3c37c9ab None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.363181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8837-648e-41e2-8fdd-de6d3c37c9ab None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.363506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae8837-648e-41e2-8fdd-de6d3c37c9ab None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.365255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 282/572] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:35:58.365352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-cccc3ae3-c455-4868-bcf5-aa73c659763c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 21:35:58.365764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae8837-648e-41e2-8fdd-de6d3c37c9ab None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.370762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 291/573] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Feb 28 21:35:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:58.370762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc3ae3-c455-4868-bcf5-aa73c659763c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.461231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc3ae3-c455-4868-bcf5-aa73c659763c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.463596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae8837-648e-41e2-8fdd-de6d3c37c9ab None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.493018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7b849-03c9-427c-ada0-6b64fcf5e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.493662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7b849-03c9-427c-ada0-6b64fcf5e66d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.493942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7b849-03c9-427c-ada0-6b64fcf5e66d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.494242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7b849-03c9-427c-ada0-6b64fcf5e66d None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.495016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7b849-03c9-427c-ada0-6b64fcf5e66d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:58.495233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430532-43a9-43ff-8287-10a734a4240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.495334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7b849-03c9-427c-ada0-6b64fcf5e66d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:58.496013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430532-43a9-43ff-8287-10a734a4240a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.496291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430532-43a9-43ff-8287-10a734a4240a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.496559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a430532-43a9-43ff-8287-10a734a4240a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.496734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7b849-03c9-427c-ada0-6b64fcf5e66d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:58.508011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a430532-43a9-43ff-8287-10a734a4240a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:58.508279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 292/574] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:58.509737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353d95-91d3-4f29-aa29-877c70988713 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.509947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a430532-43a9-43ff-8287-10a734a4240a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:58.510124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353d95-91d3-4f29-aa29-877c70988713 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.510335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50353d95-91d3-4f29-aa29-877c70988713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.527794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-50353d95-91d3-4f29-aa29-877c70988713 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:35:58.528855 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-8a430532-43a9-43ff-8287-10a734a4240a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:58.528950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-50353d95-91d3-4f29-aa29-877c70988713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:35:58.530042 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 283/575] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:58.530804 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430532-43a9-43ff-8287-10a734a4240a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.592918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 293/576] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:35:58.593743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353d95-91d3-4f29-aa29-877c70988713 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.626512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a430532-43a9-43ff-8287-10a734a4240a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.658342 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a736040-ffaa-4aec-936a-bb34999129e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.659133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a736040-ffaa-4aec-936a-bb34999129e9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.659413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a736040-ffaa-4aec-936a-bb34999129e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.659685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a736040-ffaa-4aec-936a-bb34999129e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.669789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a736040-ffaa-4aec-936a-bb34999129e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:58.671266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a736040-ffaa-4aec-936a-bb34999129e9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:58.685531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50353d95-91d3-4f29-aa29-877c70988713 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.687845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-3a736040-ffaa-4aec-936a-bb34999129e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:58.689165 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 284/577] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:58.689747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a736040-ffaa-4aec-936a-bb34999129e9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.719002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec480faa-888a-4f10-91af-259de6fe9e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.719665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec480faa-888a-4f10-91af-259de6fe9e9c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.719943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec480faa-888a-4f10-91af-259de6fe9e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.720213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec480faa-888a-4f10-91af-259de6fe9e9c None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.721040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec480faa-888a-4f10-91af-259de6fe9e9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:58.721341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec480faa-888a-4f10-91af-259de6fe9e9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:58.722785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec480faa-888a-4f10-91af-259de6fe9e9c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:58.738808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 294/578] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Feb 28 21:35:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:58.739586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec480faa-888a-4f10-91af-259de6fe9e9c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.782976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a736040-ffaa-4aec-936a-bb34999129e9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.813781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c180a2-0068-431b-a7ba-cb34982830e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.814693 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c180a2-0068-431b-a7ba-cb34982830e5 None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.814972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c180a2-0068-431b-a7ba-cb34982830e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.815242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c180a2-0068-431b-a7ba-cb34982830e5 None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/ee8e7d47becf4c03967848eda8c311be/roles/513cc23fb1004763b19adb0e0ce40802` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.829510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c180a2-0068-431b-a7ba-cb34982830e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=ee8e7d47becf4c03967848eda8c311be, role_id=513cc23fb1004763b19adb0e0ce40802)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:58.840135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c180a2-0068-431b-a7ba-cb34982830e5 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:58.840248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec480faa-888a-4f10-91af-259de6fe9e9c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:58.866607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c8710-a317-41be-9456-d0f3ec3f4d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:58.867265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8710-a317-41be-9456-d0f3ec3f4d69 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:58.867544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8710-a317-41be-9456-d0f3ec3f4d69 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:58.867817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c8710-a317-41be-9456-d0f3ec3f4d69 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:58.868530 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c8710-a317-41be-9456-d0f3ec3f4d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:58.868830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c8710-a317-41be-9456-d0f3ec3f4d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:58.870200 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c8710-a317-41be-9456-d0f3ec3f4d69 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:58.882117 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 295/579] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:58.882117 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c8710-a317-41be-9456-d0f3ec3f4d69 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.957493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 285/580] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:35:58 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/ee8e7d47becf4c03967848eda8c311be/roles/513cc23fb1004763b19adb0e0ce40802 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:35:58.958342 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c180a2-0068-431b-a7ba-cb34982830e5 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:58.978054 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c8710-a317-41be-9456-d0f3ec3f4d69 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.014140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da99dc-a864-484b-b59a-9fa2510081df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.014969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da99dc-a864-484b-b59a-9fa2510081df None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.015248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da99dc-a864-484b-b59a-9fa2510081df None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.015523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da99dc-a864-484b-b59a-9fa2510081df None admin] PATH_INFO: `/v3/roles/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.027931 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da99dc-a864-484b-b59a-9fa2510081df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:35:59.035192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-d2da99dc-a864-484b-b59a-9fa2510081df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:35:59.041223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 296/581] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:59.041223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da99dc-a864-484b-b59a-9fa2510081df None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.067271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c180a2-0068-431b-a7ba-cb34982830e5 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.106252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909fbef-7eae-446f-b16b-5359347ef6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.106926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909fbef-7eae-446f-b16b-5359347ef6f0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.107203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909fbef-7eae-446f-b16b-5359347ef6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.107471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909fbef-7eae-446f-b16b-5359347ef6f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.108203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909fbef-7eae-446f-b16b-5359347ef6f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:59.108502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909fbef-7eae-446f-b16b-5359347ef6f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.109964 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909fbef-7eae-446f-b16b-5359347ef6f0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.122055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 286/582] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:59.122941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909fbef-7eae-446f-b16b-5359347ef6f0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.158048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da99dc-a864-484b-b59a-9fa2510081df None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.191207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6c1b9-3c00-40d1-8005-7838819a5466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.191996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6c1b9-3c00-40d1-8005-7838819a5466 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.192268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6c1b9-3c00-40d1-8005-7838819a5466 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.192533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6c1b9-3c00-40d1-8005-7838819a5466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.203555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6c1b9-3c00-40d1-8005-7838819a5466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.205416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6c1b9-3c00-40d1-8005-7838819a5466 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.222143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-46a6c1b9-3c00-40d1-8005-7838819a5466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:59.228439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 297/583] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:59.228439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6c1b9-3c00-40d1-8005-7838819a5466 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.232438 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909fbef-7eae-446f-b16b-5359347ef6f0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.268446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a53b6-e912-410f-97ad-eba096d4f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.269427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a53b6-e912-410f-97ad-eba096d4f54d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.269706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a53b6-e912-410f-97ad-eba096d4f54d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.269983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a53b6-e912-410f-97ad-eba096d4f54d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.276961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a53b6-e912-410f-97ad-eba096d4f54d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.278485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a53b6-e912-410f-97ad-eba096d4f54d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.292169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-eb8a53b6-e912-410f-97ad-eba096d4f54d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:35:59.297824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 287/584] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:59.297824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a53b6-e912-410f-97ad-eba096d4f54d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.323370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6c1b9-3c00-40d1-8005-7838819a5466 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.360529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad01a8-4f6a-4a59-ab8b-5695ce4d5164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.361197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad01a8-4f6a-4a59-ab8b-5695ce4d5164 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.361473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad01a8-4f6a-4a59-ab8b-5695ce4d5164 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.361900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad01a8-4f6a-4a59-ab8b-5695ce4d5164 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.363140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad01a8-4f6a-4a59-ab8b-5695ce4d5164 None admin] RBAC: Adding query filter params (name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:59.363450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad01a8-4f6a-4a59-ab8b-5695ce4d5164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.365100 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad01a8-4f6a-4a59-ab8b-5695ce4d5164 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.379743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 298/585] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:59.379743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad01a8-4f6a-4a59-ab8b-5695ce4d5164 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.394701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a53b6-e912-410f-97ad-eba096d4f54d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.428387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dea17-c2d9-487e-866b-fa3c4d617edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.429159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dea17-c2d9-487e-866b-fa3c4d617edb None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.429437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dea17-c2d9-487e-866b-fa3c4d617edb None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.429708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dea17-c2d9-487e-866b-fa3c4d617edb None admin] PATH_INFO: `/v3/users/glance` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.436624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dea17-c2d9-487e-866b-fa3c4d617edb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.438092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dea17-c2d9-487e-866b-fa3c4d617edb None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.451731 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-080dea17-c2d9-487e-866b-fa3c4d617edb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 21:35:59.453053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 288/586] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:59.453660 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dea17-c2d9-487e-866b-fa3c4d617edb None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.492660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad01a8-4f6a-4a59-ab8b-5695ce4d5164 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.528399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaa764-b826-4079-a408-2eb6dbf9bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.529065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaa764-b826-4079-a408-2eb6dbf9bd85 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.529341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaa764-b826-4079-a408-2eb6dbf9bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.529611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaa764-b826-4079-a408-2eb6dbf9bd85 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.530368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feaa764-b826-4079-a408-2eb6dbf9bd85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:59.530670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feaa764-b826-4079-a408-2eb6dbf9bd85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.532016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feaa764-b826-4079-a408-2eb6dbf9bd85 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.543529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 299/587] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:59.544319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaa764-b826-4079-a408-2eb6dbf9bd85 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.555621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dea17-c2d9-487e-866b-fa3c4d617edb None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.589182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc900ed5-8a21-4c60-8896-467b704b2b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.589837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc900ed5-8a21-4c60-8896-467b704b2b23 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.590157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc900ed5-8a21-4c60-8896-467b704b2b23 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.590430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc900ed5-8a21-4c60-8896-467b704b2b23 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.591200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc900ed5-8a21-4c60-8896-467b704b2b23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:59.591507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc900ed5-8a21-4c60-8896-467b704b2b23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.592926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc900ed5-8a21-4c60-8896-467b704b2b23 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.604600 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 289/588] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:59.605387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc900ed5-8a21-4c60-8896-467b704b2b23 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.655248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaa764-b826-4079-a408-2eb6dbf9bd85 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.689275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd8821-d263-4fb0-8852-8219738aac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.690004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd8821-d263-4fb0-8852-8219738aac92 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.690297 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd8821-d263-4fb0-8852-8219738aac92 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.690574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd8821-d263-4fb0-8852-8219738aac92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.700934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd8821-d263-4fb0-8852-8219738aac92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.702620 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd8821-d263-4fb0-8852-8219738aac92 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.710479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc900ed5-8a21-4c60-8896-467b704b2b23 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.720759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-adbd8821-d263-4fb0-8852-8219738aac92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:35:59.722065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 300/589] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:59.722906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd8821-d263-4fb0-8852-8219738aac92 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.748931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af1030-9a60-4e39-babf-7a325d9caad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.749754 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af1030-9a60-4e39-babf-7a325d9caad8 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.750153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af1030-9a60-4e39-babf-7a325d9caad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.750503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af1030-9a60-4e39-babf-7a325d9caad8 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.751413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af1030-9a60-4e39-babf-7a325d9caad8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:59.751794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af1030-9a60-4e39-babf-7a325d9caad8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.753229 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af1030-9a60-4e39-babf-7a325d9caad8 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.771770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 290/590] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:59.772823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af1030-9a60-4e39-babf-7a325d9caad8 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.823963 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd8821-d263-4fb0-8852-8219738aac92 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.859669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75f786-414f-4950-b6aa-bd20ae86046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.860553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f786-414f-4950-b6aa-bd20ae86046b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.860934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f786-414f-4950-b6aa-bd20ae86046b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.861325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f786-414f-4950-b6aa-bd20ae86046b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.868267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75f786-414f-4950-b6aa-bd20ae86046b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.869824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75f786-414f-4950-b6aa-bd20ae86046b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.872623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af1030-9a60-4e39-babf-7a325d9caad8 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:35:59.884237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-7a75f786-414f-4950-b6aa-bd20ae86046b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:35:59.885516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 301/591] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:35:59.886308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75f786-414f-4950-b6aa-bd20ae86046b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:35:59.947076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3497d-13d4-4a09-a1ce-058d93af3a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:35:59.947648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3497d-13d4-4a09-a1ce-058d93af3a60 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:35:59.947927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3497d-13d4-4a09-a1ce-058d93af3a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:35:59.948196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3497d-13d4-4a09-a1ce-058d93af3a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:35:59.949017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3497d-13d4-4a09-a1ce-058d93af3a60 None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=368937ee42184e31b346ab9db570c122) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:35:59.949323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3497d-13d4-4a09-a1ce-058d93af3a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:35:59.950776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3497d-13d4-4a09-a1ce-058d93af3a60 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:35:59.966164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 291/592] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/role_assignments?user.id=368937ee42184e31b346ab9db570c122&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:35:59.966164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3497d-13d4-4a09-a1ce-058d93af3a60 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:00.017268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75f786-414f-4950-b6aa-bd20ae86046b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:00.055751 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf3d04-112f-44a2-b9b8-3771e1bccdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:00.056481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf3d04-112f-44a2-b9b8-3771e1bccdc8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:00.056771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf3d04-112f-44a2-b9b8-3771e1bccdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:00.057048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf3d04-112f-44a2-b9b8-3771e1bccdc8 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:00.057789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf3d04-112f-44a2-b9b8-3771e1bccdc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:00.058130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf3d04-112f-44a2-b9b8-3771e1bccdc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:00.059539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf3d04-112f-44a2-b9b8-3771e1bccdc8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:00.073542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 302/593] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:00.074519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf3d04-112f-44a2-b9b8-3771e1bccdc8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:00.079526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3497d-13d4-4a09-a1ce-058d93af3a60 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:00.117437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe9a1a-27de-4d0a-b44e-41b0a040b05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:00.118308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe9a1a-27de-4d0a-b44e-41b0a040b05c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:00.118589 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe9a1a-27de-4d0a-b44e-41b0a040b05c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:00.118860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe9a1a-27de-4d0a-b44e-41b0a040b05c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:00.130491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe9a1a-27de-4d0a-b44e-41b0a040b05c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:00.132160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe9a1a-27de-4d0a-b44e-41b0a040b05c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:00.152445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-2dbe9a1a-27de-4d0a-b44e-41b0a040b05c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:00.154049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 292/594] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:00.154791 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe9a1a-27de-4d0a-b44e-41b0a040b05c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:00.191760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf3d04-112f-44a2-b9b8-3771e1bccdc8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:00.235951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da9075-5028-491a-99b1-0bc8471a690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:00.237154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da9075-5028-491a-99b1-0bc8471a690a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:00.237781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da9075-5028-491a-99b1-0bc8471a690a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:00.238289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da9075-5028-491a-99b1-0bc8471a690a None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:00.239903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da9075-5028-491a-99b1-0bc8471a690a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:00.240424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da9075-5028-491a-99b1-0bc8471a690a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:00.243265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da9075-5028-491a-99b1-0bc8471a690a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:00.256616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe9a1a-27de-4d0a-b44e-41b0a040b05c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:00.265898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 303/595] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:00.267130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da9075-5028-491a-99b1-0bc8471a690a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:00.300789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e63b3-ee96-4120-89a3-b1010c0ce3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:00.302947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e63b3-ee96-4120-89a3-b1010c0ce3f3 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:00.303991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e63b3-ee96-4120-89a3-b1010c0ce3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:00.304585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e63b3-ee96-4120-89a3-b1010c0ce3f3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:00.314645 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e63b3-ee96-4120-89a3-b1010c0ce3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:00.316106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e63b3-ee96-4120-89a3-b1010c0ce3f3 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:00.337490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-414e63b3-ee96-4120-89a3-b1010c0ce3f3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 21:36:00.339695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 293/596] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:00.340855 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e63b3-ee96-4120-89a3-b1010c0ce3f3 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:00.382141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da9075-5028-491a-99b1-0bc8471a690a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:00.416362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1c1c0-7f2d-4d21-be46-ea75952e8cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:00.417049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1c1c0-7f2d-4d21-be46-ea75952e8cd5 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:00.417329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1c1c0-7f2d-4d21-be46-ea75952e8cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:00.417603 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1c1c0-7f2d-4d21-be46-ea75952e8cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:00.418361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1c1c0-7f2d-4d21-be46-ea75952e8cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:00.418720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1c1c0-7f2d-4d21-be46-ea75952e8cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:00.420155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1c1c0-7f2d-4d21-be46-ea75952e8cd5 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:00.437034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 304/597] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:00.437973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1c1c0-7f2d-4d21-be46-ea75952e8cd5 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:00.469475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e63b3-ee96-4120-89a3-b1010c0ce3f3 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:00.514469 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923dfde-cabc-415a-a3b4-5286385592cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:00.516022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923dfde-cabc-415a-a3b4-5286385592cf None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:00.516486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923dfde-cabc-415a-a3b4-5286385592cf None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:00.516966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923dfde-cabc-415a-a3b4-5286385592cf None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/8182c282a5754f05b4bb6bb7057fa7ab/roles/513cc23fb1004763b19adb0e0ce40802` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:00.532983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923dfde-cabc-415a-a3b4-5286385592cf None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=8182c282a5754f05b4bb6bb7057fa7ab, role_id=513cc23fb1004763b19adb0e0ce40802)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:00.534565 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923dfde-cabc-415a-a3b4-5286385592cf None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:00.545615 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1c1c0-7f2d-4d21-be46-ea75952e8cd5 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:00.579847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98804a-cd02-41ac-93ef-8685cbe51b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:00.580817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98804a-cd02-41ac-93ef-8685cbe51b61 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:00.581280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98804a-cd02-41ac-93ef-8685cbe51b61 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:00.581743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98804a-cd02-41ac-93ef-8685cbe51b61 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:00.582790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98804a-cd02-41ac-93ef-8685cbe51b61 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:00.583276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98804a-cd02-41ac-93ef-8685cbe51b61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:00.585545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98804a-cd02-41ac-93ef-8685cbe51b61 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:00.603662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 305/598] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Feb 28 21:36:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:00.604886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98804a-cd02-41ac-93ef-8685cbe51b61 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:00.676679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 294/599] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:36:00 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/8182c282a5754f05b4bb6bb7057fa7ab/roles/513cc23fb1004763b19adb0e0ce40802 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:36:00.684144 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923dfde-cabc-415a-a3b4-5286385592cf None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:00.757039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98804a-cd02-41ac-93ef-8685cbe51b61 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:00.829818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d3630-8296-45d3-923c-0045fa35ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:00.834914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3630-8296-45d3-923c-0045fa35ecdf None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:00.835539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3630-8296-45d3-923c-0045fa35ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:00.836016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3630-8296-45d3-923c-0045fa35ecdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:00.852037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d3630-8296-45d3-923c-0045fa35ecdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:00.854705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d3630-8296-45d3-923c-0045fa35ecdf None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:00.862412 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923dfde-cabc-415a-a3b4-5286385592cf None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:00.885007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-6b8d3630-8296-45d3-923c-0045fa35ecdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:00.886302 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 306/600] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:00.895929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d3630-8296-45d3-923c-0045fa35ecdf None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:00.917418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c25cb-2d8e-4232-ae05-31dd3b7b2a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:00.918261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c25cb-2d8e-4232-ae05-31dd3b7b2a35 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:00.918542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c25cb-2d8e-4232-ae05-31dd3b7b2a35 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:00.918818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c25cb-2d8e-4232-ae05-31dd3b7b2a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:00.930181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c25cb-2d8e-4232-ae05-31dd3b7b2a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:00.931648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c25cb-2d8e-4232-ae05-31dd3b7b2a35 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:00.949155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-8e3c25cb-2d8e-4232-ae05-31dd3b7b2a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:00.950517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 295/601] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:00.956764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c25cb-2d8e-4232-ae05-31dd3b7b2a35 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:01.002190 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d3630-8296-45d3-923c-0045fa35ecdf None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:01.041703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951201e0-7da1-46da-8732-d7f2473b3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:01.042489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951201e0-7da1-46da-8732-d7f2473b3a2d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:01.042678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951201e0-7da1-46da-8732-d7f2473b3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:01.042953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951201e0-7da1-46da-8732-d7f2473b3a2d None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:01.043739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951201e0-7da1-46da-8732-d7f2473b3a2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:01.044042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951201e0-7da1-46da-8732-d7f2473b3a2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:01.045472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951201e0-7da1-46da-8732-d7f2473b3a2d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:01.060387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 307/602] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:01.066747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951201e0-7da1-46da-8732-d7f2473b3a2d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:01.077624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c25cb-2d8e-4232-ae05-31dd3b7b2a35 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:01.135781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae13a1-cb20-42ea-aa46-4fe13a1134fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:01.136381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae13a1-cb20-42ea-aa46-4fe13a1134fc None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:01.136662 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae13a1-cb20-42ea-aa46-4fe13a1134fc None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:01.136936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae13a1-cb20-42ea-aa46-4fe13a1134fc None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:01.137668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae13a1-cb20-42ea-aa46-4fe13a1134fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:01.137974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae13a1-cb20-42ea-aa46-4fe13a1134fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:01.139390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae13a1-cb20-42ea-aa46-4fe13a1134fc None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:01.158092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 296/603] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:01.171499 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae13a1-cb20-42ea-aa46-4fe13a1134fc None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:01.182928 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951201e0-7da1-46da-8732-d7f2473b3a2d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:01.220101 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916f50-a05d-4891-8b72-97330b917495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:01.221061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916f50-a05d-4891-8b72-97330b917495 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:01.221401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916f50-a05d-4891-8b72-97330b917495 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:01.221667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c916f50-a05d-4891-8b72-97330b917495 None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/500eaf6aadff441ca1e535443e1d8c03/roles/513cc23fb1004763b19adb0e0ce40802` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:01.238559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c916f50-a05d-4891-8b72-97330b917495 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=500eaf6aadff441ca1e535443e1d8c03, role_id=513cc23fb1004763b19adb0e0ce40802)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:01.240118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c916f50-a05d-4891-8b72-97330b917495 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:01.329550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae13a1-cb20-42ea-aa46-4fe13a1134fc None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:01.333035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 308/604] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:36:01 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/500eaf6aadff441ca1e535443e1d8c03/roles/513cc23fb1004763b19adb0e0ce40802 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:36:01.366282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5395c-053d-42c8-8a29-16de73ac0bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:01.367099 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5395c-053d-42c8-8a29-16de73ac0bc9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:01.367384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5395c-053d-42c8-8a29-16de73ac0bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:01.367660 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5395c-053d-42c8-8a29-16de73ac0bc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:01.375223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5395c-053d-42c8-8a29-16de73ac0bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:01.376933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5395c-053d-42c8-8a29-16de73ac0bc9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:01.393307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-3da5395c-053d-42c8-8a29-16de73ac0bc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:01.394898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 297/605] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:01.405106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916f50-a05d-4891-8b72-97330b917495 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:01.439200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd65d1-154d-4f74-9724-2267f6d3660f None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:01.439535 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd65d1-154d-4f74-9724-2267f6d3660f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:01.439763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd65d1-154d-4f74-9724-2267f6d3660f None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:01.442062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 298/606] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:01.448398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9528679-8cc5-491e-9e29-fcd5b0be8805 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:01.448723 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9528679-8cc5-491e-9e29-fcd5b0be8805 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:01.448956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9528679-8cc5-491e-9e29-fcd5b0be8805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:01.467647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-e9528679-8cc5-491e-9e29-fcd5b0be8805 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:01.468892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e9528679-8cc5-491e-9e29-fcd5b0be8805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:01.564817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 299/607] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:01.579880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c916f50-a05d-4891-8b72-97330b917495 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:01.601509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9528679-8cc5-491e-9e29-fcd5b0be8805 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:01.624264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1227b-d4be-47c1-9682-88fdca7148f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:01.625442 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1227b-d4be-47c1-9682-88fdca7148f3 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:01.625871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1227b-d4be-47c1-9682-88fdca7148f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:01.626329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1227b-d4be-47c1-9682-88fdca7148f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:01.627280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1227b-d4be-47c1-9682-88fdca7148f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:01.627732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1227b-d4be-47c1-9682-88fdca7148f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:01.629931 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1227b-d4be-47c1-9682-88fdca7148f3 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:01.645328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 309/608] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:01.654990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1227b-d4be-47c1-9682-88fdca7148f3 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:01.717714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9528679-8cc5-491e-9e29-fcd5b0be8805 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:01.753368 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880c5c4-dff6-4bbd-90f5-9649bf234319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:01.754388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880c5c4-dff6-4bbd-90f5-9649bf234319 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:01.754770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880c5c4-dff6-4bbd-90f5-9649bf234319 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:01.755155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880c5c4-dff6-4bbd-90f5-9649bf234319 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:01.766943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880c5c4-dff6-4bbd-90f5-9649bf234319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:01.774286 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-f880c5c4-dff6-4bbd-90f5-9649bf234319 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:36:01.775876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 300/609] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:01.782189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880c5c4-dff6-4bbd-90f5-9649bf234319 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:01.821882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1227b-d4be-47c1-9682-88fdca7148f3 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:01.857627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15aa8f-b5f2-4adc-b40d-8c940f8a4017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:01.859668 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15aa8f-b5f2-4adc-b40d-8c940f8a4017 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:01.860694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15aa8f-b5f2-4adc-b40d-8c940f8a4017 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:01.860975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15aa8f-b5f2-4adc-b40d-8c940f8a4017 None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/b4664710493b462bafae3908c582e9bc/roles/513cc23fb1004763b19adb0e0ce40802` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:01.893946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15aa8f-b5f2-4adc-b40d-8c940f8a4017 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=b4664710493b462bafae3908c582e9bc, role_id=513cc23fb1004763b19adb0e0ce40802)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:01.895509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15aa8f-b5f2-4adc-b40d-8c940f8a4017 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:01.963187 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880c5c4-dff6-4bbd-90f5-9649bf234319 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:01.984532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 310/610] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:36:01 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/b4664710493b462bafae3908c582e9bc/roles/513cc23fb1004763b19adb0e0ce40802 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:36:01.999211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9e94f-45f2-43e0-b063-17d0af5f5634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:01.999906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e94f-45f2-43e0-b063-17d0af5f5634 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:02.000188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e94f-45f2-43e0-b063-17d0af5f5634 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:02.000525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e94f-45f2-43e0-b063-17d0af5f5634 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:02.001463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9e94f-45f2-43e0-b063-17d0af5f5634 None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:02.001773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9e94f-45f2-43e0-b063-17d0af5f5634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:02.003177 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9e94f-45f2-43e0-b063-17d0af5f5634 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:02.013108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 301/611] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:36:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:02.018561 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15aa8f-b5f2-4adc-b40d-8c940f8a4017 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:02.148614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15aa8f-b5f2-4adc-b40d-8c940f8a4017 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:02.186813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268db8f-ccbb-4fd9-a5d7-52835b4eeb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:02.187622 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268db8f-ccbb-4fd9-a5d7-52835b4eeb60 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:02.187904 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268db8f-ccbb-4fd9-a5d7-52835b4eeb60 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:02.188175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268db8f-ccbb-4fd9-a5d7-52835b4eeb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:02.200667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268db8f-ccbb-4fd9-a5d7-52835b4eeb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:02.202163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268db8f-ccbb-4fd9-a5d7-52835b4eeb60 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:02.221848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-2268db8f-ccbb-4fd9-a5d7-52835b4eeb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:02.223531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 311/612] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:02.231450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9e94f-45f2-43e0-b063-17d0af5f5634 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:02.403210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9e94f-45f2-43e0-b063-17d0af5f5634 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:02.438910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a080-4378-483e-bee1-aeb83abe539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:02.439625 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a080-4378-483e-bee1-aeb83abe539a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:02.439905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a080-4378-483e-bee1-aeb83abe539a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:02.440172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a080-4378-483e-bee1-aeb83abe539a None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:02.440884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a080-4378-483e-bee1-aeb83abe539a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:02.441180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a080-4378-483e-bee1-aeb83abe539a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:02.442570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a080-4378-483e-bee1-aeb83abe539a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:02.454729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 302/613] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:02.460768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268db8f-ccbb-4fd9-a5d7-52835b4eeb60 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:02.573035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268db8f-ccbb-4fd9-a5d7-52835b4eeb60 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:02.607014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad66d2-25b9-4438-8324-d209c3e03a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:02.608111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad66d2-25b9-4438-8324-d209c3e03a2d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:02.608563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad66d2-25b9-4438-8324-d209c3e03a2d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:02.609004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad66d2-25b9-4438-8324-d209c3e03a2d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:02.617406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad66d2-25b9-4438-8324-d209c3e03a2d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:02.619138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad66d2-25b9-4438-8324-d209c3e03a2d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:02.641449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-47ad66d2-25b9-4438-8324-d209c3e03a2d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 21:36:02.642962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 312/614] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:02.649274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a080-4378-483e-bee1-aeb83abe539a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:02.682226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ac40-9335-4ef1-8233-23250e572f21 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:02.682785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ac40-9335-4ef1-8233-23250e572f21 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:02.683228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285ac40-9335-4ef1-8233-23250e572f21 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:02.685163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 313/615] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:02.691220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba42b-874a-432e-ae05-7f593a738333 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:02.691706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba42b-874a-432e-ae05-7f593a738333 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:02.692150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba42b-874a-432e-ae05-7f593a738333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:02.709195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-650ba42b-874a-432e-ae05-7f593a738333 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:02.710687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-650ba42b-874a-432e-ae05-7f593a738333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:02.801185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a080-4378-483e-bee1-aeb83abe539a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:02.846004 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad451e-465d-4931-8ccf-46cecc0d7a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:02.846691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad451e-465d-4931-8ccf-46cecc0d7a33 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:02.846962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad451e-465d-4931-8ccf-46cecc0d7a33 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:02.847230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad451e-465d-4931-8ccf-46cecc0d7a33 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:02.848190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad451e-465d-4931-8ccf-46cecc0d7a33 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:02.848498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad451e-465d-4931-8ccf-46cecc0d7a33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:02.849935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad451e-465d-4931-8ccf-46cecc0d7a33 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:02.852274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 314/616] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:02.868537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 303/617] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Feb 28 21:36:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:02.874076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba42b-874a-432e-ae05-7f593a738333 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:02.888579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad451e-465d-4931-8ccf-46cecc0d7a33 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:02.992324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba42b-874a-432e-ae05-7f593a738333 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:03.035086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffec4c-83cd-45c5-a6c3-a690047c35d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:03.035750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffec4c-83cd-45c5-a6c3-a690047c35d6 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:03.036029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffec4c-83cd-45c5-a6c3-a690047c35d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:03.036303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffec4c-83cd-45c5-a6c3-a690047c35d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:03.092694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad451e-465d-4931-8ccf-46cecc0d7a33 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:03.144013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffec4c-83cd-45c5-a6c3-a690047c35d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:03.146211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffec4c-83cd-45c5-a6c3-a690047c35d6 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:03.156261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66e1b3-96b4-4230-97ac-41d49b6f3fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:03.157064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e1b3-96b4-4230-97ac-41d49b6f3fcc None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:03.157773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e1b3-96b4-4230-97ac-41d49b6f3fcc None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:03.158098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66e1b3-96b4-4230-97ac-41d49b6f3fcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:03.176630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66e1b3-96b4-4230-97ac-41d49b6f3fcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:03.183955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-ff66e1b3-96b4-4230-97ac-41d49b6f3fcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:36:03.190021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 304/618] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:03.191273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66e1b3-96b4-4230-97ac-41d49b6f3fcc None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:03.325510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66e1b3-96b4-4230-97ac-41d49b6f3fcc None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:03.336411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 315/619] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:36:03.342176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffec4c-83cd-45c5-a6c3-a690047c35d6 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:03.405154 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da697f21-0b42-41d0-8360-1a7dd9d40424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:03.405836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da697f21-0b42-41d0-8360-1a7dd9d40424 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:03.406141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da697f21-0b42-41d0-8360-1a7dd9d40424 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:03.406414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da697f21-0b42-41d0-8360-1a7dd9d40424 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:03.407155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da697f21-0b42-41d0-8360-1a7dd9d40424 None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:03.407455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da697f21-0b42-41d0-8360-1a7dd9d40424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:03.408811 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da697f21-0b42-41d0-8360-1a7dd9d40424 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:03.424092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 305/620] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:03.431696 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da697f21-0b42-41d0-8360-1a7dd9d40424 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:03.464520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffec4c-83cd-45c5-a6c3-a690047c35d6 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:03.508874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba3787-6ddc-431c-970f-238904106c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:03.510168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3787-6ddc-431c-970f-238904106c22 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:03.510653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3787-6ddc-431c-970f-238904106c22 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:03.512913 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba3787-6ddc-431c-970f-238904106c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:03.524965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba3787-6ddc-431c-970f-238904106c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:03.526767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba3787-6ddc-431c-970f-238904106c22 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:03.546602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-e7ba3787-6ddc-431c-970f-238904106c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:03.548416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 316/621] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:03.553586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba3787-6ddc-431c-970f-238904106c22 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:03.624898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da697f21-0b42-41d0-8360-1a7dd9d40424 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:03.664264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750318-5794-4a56-a750-d3c37ab4aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:03.665334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750318-5794-4a56-a750-d3c37ab4aab3 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:03.665750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750318-5794-4a56-a750-d3c37ab4aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:03.666178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750318-5794-4a56-a750-d3c37ab4aab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:03.684278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3750318-5794-4a56-a750-d3c37ab4aab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:03.686897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3750318-5794-4a56-a750-d3c37ab4aab3 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:03.712482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-e3750318-5794-4a56-a750-d3c37ab4aab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:03.714270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 306/622] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:03.715651 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c4e2-a407-4d5f-93c6-e1eeac9a0e72 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:03.716102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c4e2-a407-4d5f-93c6-e1eeac9a0e72 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:03.716540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971c4e2-a407-4d5f-93c6-e1eeac9a0e72 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:03.718681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 307/623] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:03.719560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971c4e2-a407-4d5f-93c6-e1eeac9a0e72 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:03.728369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba3787-6ddc-431c-970f-238904106c22 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:03.765915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0cdef-7379-459d-b427-8b3dbab8181d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:03.766879 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0cdef-7379-459d-b427-8b3dbab8181d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:03.767337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0cdef-7379-459d-b427-8b3dbab8181d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:03.767922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0cdef-7379-459d-b427-8b3dbab8181d None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:03.768872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0cdef-7379-459d-b427-8b3dbab8181d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:03.769374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0cdef-7379-459d-b427-8b3dbab8181d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:03.771036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0cdef-7379-459d-b427-8b3dbab8181d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:03.784213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 317/624] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:03.785868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af375a-db6c-4783-8ffc-a3918f6c3ec4 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:03.786401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af375a-db6c-4783-8ffc-a3918f6c3ec4 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:03.786873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af375a-db6c-4783-8ffc-a3918f6c3ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:03.804702 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-39af375a-db6c-4783-8ffc-a3918f6c3ec4 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:03.806492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-39af375a-db6c-4783-8ffc-a3918f6c3ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:03.829405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971c4e2-a407-4d5f-93c6-e1eeac9a0e72 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:03.862844 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277b57d-362a-47f0-a661-196239a6f3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:03.863511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277b57d-362a-47f0-a661-196239a6f3e1 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:03.863785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277b57d-362a-47f0-a661-196239a6f3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:03.864055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277b57d-362a-47f0-a661-196239a6f3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:03.864977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277b57d-362a-47f0-a661-196239a6f3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:03.865083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277b57d-362a-47f0-a661-196239a6f3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:03.866656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277b57d-362a-47f0-a661-196239a6f3e1 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:03.880102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 308/625] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:03.880861 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277b57d-362a-47f0-a661-196239a6f3e1 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:03.891067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 318/626] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:03.892263 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af375a-db6c-4783-8ffc-a3918f6c3ec4 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:03.978792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277b57d-362a-47f0-a661-196239a6f3e1 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:03.993626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af375a-db6c-4783-8ffc-a3918f6c3ec4 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:04.012654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406aca0-5ce1-4d06-87a1-f94b8c7494b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.013446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406aca0-5ce1-4d06-87a1-f94b8c7494b2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.013722 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406aca0-5ce1-4d06-87a1-f94b8c7494b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.014003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406aca0-5ce1-4d06-87a1-f94b8c7494b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.020864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406aca0-5ce1-4d06-87a1-f94b8c7494b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:04.023111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406aca0-5ce1-4d06-87a1-f94b8c7494b2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:04.030556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d1965-4783-4125-b8dd-c4e528f70ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.031760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d1965-4783-4125-b8dd-c4e528f70ffb None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.032272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d1965-4783-4125-b8dd-c4e528f70ffb None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.032741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d1965-4783-4125-b8dd-c4e528f70ffb None admin] PATH_INFO: `/v3/users/swift` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.036177 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-e406aca0-5ce1-4d06-87a1-f94b8c7494b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:04.041086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d1965-4783-4125-b8dd-c4e528f70ffb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:04.042150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 309/627] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:04.043041 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406aca0-5ce1-4d06-87a1-f94b8c7494b2 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:04.043301 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d1965-4783-4125-b8dd-c4e528f70ffb None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:04.062937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-259d1965-4783-4125-b8dd-c4e528f70ffb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 21:36:04.065231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 319/628] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:04.066225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d1965-4783-4125-b8dd-c4e528f70ffb None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:04.159581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406aca0-5ce1-4d06-87a1-f94b8c7494b2 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:04.167581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d1965-4783-4125-b8dd-c4e528f70ffb None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:04.193658 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f308e3-13e1-4bd6-8c38-d8c6bcd51809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.195063 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f308e3-13e1-4bd6-8c38-d8c6bcd51809 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.195344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f308e3-13e1-4bd6-8c38-d8c6bcd51809 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.195614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f308e3-13e1-4bd6-8c38-d8c6bcd51809 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.201488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4435314-9778-42eb-ae35-38e0cb99b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.202185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4435314-9778-42eb-ae35-38e0cb99b58b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.202468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4435314-9778-42eb-ae35-38e0cb99b58b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.202738 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4435314-9778-42eb-ae35-38e0cb99b58b None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.203519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4435314-9778-42eb-ae35-38e0cb99b58b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:04.203819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4435314-9778-42eb-ae35-38e0cb99b58b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:04.205240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4435314-9778-42eb-ae35-38e0cb99b58b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:04.205978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f308e3-13e1-4bd6-8c38-d8c6bcd51809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:04.213172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-a1f308e3-13e1-4bd6-8c38-d8c6bcd51809 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:36:04.214551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 310/629] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:04.215235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f308e3-13e1-4bd6-8c38-d8c6bcd51809 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:04.221594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 320/630] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:04.221594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb305b94-6719-4116-b4f0-4d50ca829bd4 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.221594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb305b94-6719-4116-b4f0-4d50ca829bd4 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.221594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb305b94-6719-4116-b4f0-4d50ca829bd4 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.221594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 321/631] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:04.222798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb305b94-6719-4116-b4f0-4d50ca829bd4 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:04.321463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f308e3-13e1-4bd6-8c38-d8c6bcd51809 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:04.325740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb305b94-6719-4116-b4f0-4d50ca829bd4 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:04.355093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a74d17-37fb-4264-a487-11adc2cbaf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.356418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74d17-37fb-4264-a487-11adc2cbaf26 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.356770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74d17-37fb-4264-a487-11adc2cbaf26 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.357120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a74d17-37fb-4264-a487-11adc2cbaf26 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.357975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a74d17-37fb-4264-a487-11adc2cbaf26 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:04.358293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a74d17-37fb-4264-a487-11adc2cbaf26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:04.359778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a74d17-37fb-4264-a487-11adc2cbaf26 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:04.363865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ffbfc-6551-499e-8b2e-3235270cc3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.364517 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ffbfc-6551-499e-8b2e-3235270cc3ba None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.364799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ffbfc-6551-499e-8b2e-3235270cc3ba None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.365074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ffbfc-6551-499e-8b2e-3235270cc3ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.366207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ffbfc-6551-499e-8b2e-3235270cc3ba None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=ee8e7d47becf4c03967848eda8c311be) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:04.366540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ffbfc-6551-499e-8b2e-3235270cc3ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:04.367949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ffbfc-6551-499e-8b2e-3235270cc3ba None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:04.382021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 311/633] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:04.382021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a74d17-37fb-4264-a487-11adc2cbaf26 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:04.382292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 322/632] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/role_assignments?user.id=ee8e7d47becf4c03967848eda8c311be&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:04.383758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235745fd-ec43-413e-be9f-48933c2c668d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.384036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235745fd-ec43-413e-be9f-48933c2c668d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.384315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235745fd-ec43-413e-be9f-48933c2c668d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.404966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-235745fd-ec43-413e-be9f-48933c2c668d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:04.406837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-235745fd-ec43-413e-be9f-48933c2c668d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:04.499839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 323/634] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:04.501091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235745fd-ec43-413e-be9f-48933c2c668d None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:04.525717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a74d17-37fb-4264-a487-11adc2cbaf26 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:04.576682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7651e1-0f86-4a07-bd09-6f98461dc12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.577362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7651e1-0f86-4a07-bd09-6f98461dc12d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.577668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7651e1-0f86-4a07-bd09-6f98461dc12d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.578114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7651e1-0f86-4a07-bd09-6f98461dc12d None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.578724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7651e1-0f86-4a07-bd09-6f98461dc12d None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:04.579030 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7651e1-0f86-4a07-bd09-6f98461dc12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:04.580401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7651e1-0f86-4a07-bd09-6f98461dc12d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:04.592492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 312/635] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:04.593928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7651e1-0f86-4a07-bd09-6f98461dc12d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:04.640140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235745fd-ec43-413e-be9f-48933c2c668d None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:04.674404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f4159-05b4-40ab-9662-875561ea5a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.675199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4159-05b4-40ab-9662-875561ea5a20 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.675474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4159-05b4-40ab-9662-875561ea5a20 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.675743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f4159-05b4-40ab-9662-875561ea5a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.686984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f4159-05b4-40ab-9662-875561ea5a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:04.688408 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f4159-05b4-40ab-9662-875561ea5a20 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:04.705482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-ec5f4159-05b4-40ab-9662-875561ea5a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:04.707033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 324/636] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:04.712980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f4159-05b4-40ab-9662-875561ea5a20 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:04.723107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7651e1-0f86-4a07-bd09-6f98461dc12d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:04.760109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b12635-bc7e-4e39-ac1e-f2ad52e77ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.760877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b12635-bc7e-4e39-ac1e-f2ad52e77ec0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.761156 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b12635-bc7e-4e39-ac1e-f2ad52e77ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.761424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b12635-bc7e-4e39-ac1e-f2ad52e77ec0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.773245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b12635-bc7e-4e39-ac1e-f2ad52e77ec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:04.780103 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-c9b12635-bc7e-4e39-ac1e-f2ad52e77ec0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:36:04.781615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 313/637] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:04.786610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b12635-bc7e-4e39-ac1e-f2ad52e77ec0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:04.844240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f4159-05b4-40ab-9662-875561ea5a20 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:04.884213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d576a-9295-4f66-9c85-e0e41cee209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.885156 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d576a-9295-4f66-9c85-e0e41cee209a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.885437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d576a-9295-4f66-9c85-e0e41cee209a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.886033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d576a-9295-4f66-9c85-e0e41cee209a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.891147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b12635-bc7e-4e39-ac1e-f2ad52e77ec0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:04.898213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d576a-9295-4f66-9c85-e0e41cee209a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:04.900057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d576a-9295-4f66-9c85-e0e41cee209a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:04.919352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-869d576a-9295-4f66-9c85-e0e41cee209a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:04.924951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 325/638] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:04.924951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d576a-9295-4f66-9c85-e0e41cee209a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:04.929233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4893b3-4f5a-4b23-978a-0fb2374f4988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:04.929896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4893b3-4f5a-4b23-978a-0fb2374f4988 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.930204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4893b3-4f5a-4b23-978a-0fb2374f4988 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.930476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4893b3-4f5a-4b23-978a-0fb2374f4988 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.931195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4893b3-4f5a-4b23-978a-0fb2374f4988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:04.931496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4893b3-4f5a-4b23-978a-0fb2374f4988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:04.932942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4893b3-4f5a-4b23-978a-0fb2374f4988 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:04.945227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 314/639] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:04.946338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3249937-763a-46c8-8833-718fd7d5f1e2 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:04.946621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3249937-763a-46c8-8833-718fd7d5f1e2 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:04.946893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3249937-763a-46c8-8833-718fd7d5f1e2 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:04.950031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 315/640] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:04.950031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3249937-763a-46c8-8833-718fd7d5f1e2 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.030045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d576a-9295-4f66-9c85-e0e41cee209a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.049189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3249937-763a-46c8-8833-718fd7d5f1e2 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.064246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480eb48-4a08-4538-80c9-361eb8d39ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.065823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480eb48-4a08-4538-80c9-361eb8d39ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.066142 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480eb48-4a08-4538-80c9-361eb8d39ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.066417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480eb48-4a08-4538-80c9-361eb8d39ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.067166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480eb48-4a08-4538-80c9-361eb8d39ae0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:05.067465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480eb48-4a08-4538-80c9-361eb8d39ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.069398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480eb48-4a08-4538-80c9-361eb8d39ae0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.080399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 326/641] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:05.081037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480eb48-4a08-4538-80c9-361eb8d39ae0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.089699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54522477-d73a-4930-b0b4-3fe34bca4937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.090702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522477-d73a-4930-b0b4-3fe34bca4937 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.091043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522477-d73a-4930-b0b4-3fe34bca4937 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.091313 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522477-d73a-4930-b0b4-3fe34bca4937 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.092045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54522477-d73a-4930-b0b4-3fe34bca4937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:05.092402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54522477-d73a-4930-b0b4-3fe34bca4937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.093880 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54522477-d73a-4930-b0b4-3fe34bca4937 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.107443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 316/642] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:05.108721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f8721-b771-4916-9ff4-95eedf39e618 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.109010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f8721-b771-4916-9ff4-95eedf39e618 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.109287 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f8721-b771-4916-9ff4-95eedf39e618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.126654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-874f8721-b771-4916-9ff4-95eedf39e618 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:05.127934 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-874f8721-b771-4916-9ff4-95eedf39e618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:05.183370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480eb48-4a08-4538-80c9-361eb8d39ae0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.206192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 317/643] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:05.206192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f8721-b771-4916-9ff4-95eedf39e618 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.229908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590df82-c2bf-4995-ab5e-666e979d84f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.230732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590df82-c2bf-4995-ab5e-666e979d84f4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.231016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590df82-c2bf-4995-ab5e-666e979d84f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.231288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590df82-c2bf-4995-ab5e-666e979d84f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.237974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590df82-c2bf-4995-ab5e-666e979d84f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.239423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590df82-c2bf-4995-ab5e-666e979d84f4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.254297 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-5590df82-c2bf-4995-ab5e-666e979d84f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:05.260871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 327/644] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:05.260871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590df82-c2bf-4995-ab5e-666e979d84f4 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.299810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f8721-b771-4916-9ff4-95eedf39e618 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.334274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308ffe-f0eb-44fe-9875-4c153deecde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.335219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308ffe-f0eb-44fe-9875-4c153deecde4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.335504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308ffe-f0eb-44fe-9875-4c153deecde4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.335776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308ffe-f0eb-44fe-9875-4c153deecde4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.348187 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308ffe-f0eb-44fe-9875-4c153deecde4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.350805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308ffe-f0eb-44fe-9875-4c153deecde4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.356908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590df82-c2bf-4995-ab5e-666e979d84f4 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.368531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-67308ffe-f0eb-44fe-9875-4c153deecde4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:05.374362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 318/645] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:05.374362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308ffe-f0eb-44fe-9875-4c153deecde4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.396439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d07ffc-5ada-4b3f-a6a4-7f26e2849557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.397776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d07ffc-5ada-4b3f-a6a4-7f26e2849557 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.398100 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d07ffc-5ada-4b3f-a6a4-7f26e2849557 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.398379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d07ffc-5ada-4b3f-a6a4-7f26e2849557 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.405524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d07ffc-5ada-4b3f-a6a4-7f26e2849557 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.406974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d07ffc-5ada-4b3f-a6a4-7f26e2849557 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.420502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a2d07ffc-5ada-4b3f-a6a4-7f26e2849557 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 21:36:05.426130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 328/646] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:05.426130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d07ffc-5ada-4b3f-a6a4-7f26e2849557 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.476851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308ffe-f0eb-44fe-9875-4c153deecde4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.510018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b219a1-d93d-42b6-9899-9191f5c77fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.510814 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b219a1-d93d-42b6-9899-9191f5c77fc6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.511094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b219a1-d93d-42b6-9899-9191f5c77fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.511364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b219a1-d93d-42b6-9899-9191f5c77fc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.521400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b219a1-d93d-42b6-9899-9191f5c77fc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:05.524895 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d07ffc-5ada-4b3f-a6a4-7f26e2849557 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.529690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-43b219a1-d93d-42b6-9899-9191f5c77fc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:36:05.535137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 319/647] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:05.535137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b219a1-d93d-42b6-9899-9191f5c77fc6 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.563039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b4f91-772c-4b11-a9f0-e21243bcdfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.563624 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b4f91-772c-4b11-a9f0-e21243bcdfd1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.563903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b4f91-772c-4b11-a9f0-e21243bcdfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.564179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b4f91-772c-4b11-a9f0-e21243bcdfd1 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.564967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b4f91-772c-4b11-a9f0-e21243bcdfd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:05.565273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b4f91-772c-4b11-a9f0-e21243bcdfd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.566718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b4f91-772c-4b11-a9f0-e21243bcdfd1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.578740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 329/648] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:05.579616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b4f91-772c-4b11-a9f0-e21243bcdfd1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.638043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b219a1-d93d-42b6-9899-9191f5c77fc6 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.670650 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbad80-a1a6-4e18-bc39-734daaf1bf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.671310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbad80-a1a6-4e18-bc39-734daaf1bf15 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.671605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbad80-a1a6-4e18-bc39-734daaf1bf15 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.671865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbad80-a1a6-4e18-bc39-734daaf1bf15 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.672579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbad80-a1a6-4e18-bc39-734daaf1bf15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:05.672878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbad80-a1a6-4e18-bc39-734daaf1bf15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.674261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbad80-a1a6-4e18-bc39-734daaf1bf15 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.677827 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b4f91-772c-4b11-a9f0-e21243bcdfd1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.690290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 320/649] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:05.690290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbad80-a1a6-4e18-bc39-734daaf1bf15 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.715363 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786dc5-2693-45c6-a563-22c68f37819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.716027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786dc5-2693-45c6-a563-22c68f37819c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.716306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786dc5-2693-45c6-a563-22c68f37819c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.716578 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786dc5-2693-45c6-a563-22c68f37819c None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.717403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786dc5-2693-45c6-a563-22c68f37819c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:05.717714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786dc5-2693-45c6-a563-22c68f37819c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.719161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786dc5-2693-45c6-a563-22c68f37819c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.736846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 330/650] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:05.742629 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786dc5-2693-45c6-a563-22c68f37819c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.785904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbad80-a1a6-4e18-bc39-734daaf1bf15 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.821036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2267fe-9763-43eb-be02-92fe4783291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.821608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2267fe-9763-43eb-be02-92fe4783291a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.821886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2267fe-9763-43eb-be02-92fe4783291a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.822183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2267fe-9763-43eb-be02-92fe4783291a None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.822920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2267fe-9763-43eb-be02-92fe4783291a None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:05.823218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2267fe-9763-43eb-be02-92fe4783291a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.824643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2267fe-9763-43eb-be02-92fe4783291a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.837463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 321/651] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:05.838351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2267fe-9763-43eb-be02-92fe4783291a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.838933 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786dc5-2693-45c6-a563-22c68f37819c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.878306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d196add-fa17-4ca8-94b7-30b5a3654de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.879476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196add-fa17-4ca8-94b7-30b5a3654de2 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.879962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196add-fa17-4ca8-94b7-30b5a3654de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.880411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196add-fa17-4ca8-94b7-30b5a3654de2 None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/368937ee42184e31b346ab9db570c122/roles/513cc23fb1004763b19adb0e0ce40802` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.896413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d196add-fa17-4ca8-94b7-30b5a3654de2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=368937ee42184e31b346ab9db570c122, role_id=513cc23fb1004763b19adb0e0ce40802)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.897924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d196add-fa17-4ca8-94b7-30b5a3654de2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.935776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2267fe-9763-43eb-be02-92fe4783291a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:05.957284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 331/652] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:36:05 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/368937ee42184e31b346ab9db570c122/roles/513cc23fb1004763b19adb0e0ce40802 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:36:05.958310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d196add-fa17-4ca8-94b7-30b5a3654de2 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:05.968092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a62fd-9d3b-4cd9-a6d7-8351c88dd498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:05.969163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a62fd-9d3b-4cd9-a6d7-8351c88dd498 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:05.970718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a62fd-9d3b-4cd9-a6d7-8351c88dd498 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:05.970718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a62fd-9d3b-4cd9-a6d7-8351c88dd498 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:05.980075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a62fd-9d3b-4cd9-a6d7-8351c88dd498 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:05.981852 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a62fd-9d3b-4cd9-a6d7-8351c88dd498 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:05.997689 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-7c9a62fd-9d3b-4cd9-a6d7-8351c88dd498 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 28 21:36:05.999576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 322/653] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:06.000736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a62fd-9d3b-4cd9-a6d7-8351c88dd498 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:06.086751 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d196add-fa17-4ca8-94b7-30b5a3654de2 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:06.111436 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a62fd-9d3b-4cd9-a6d7-8351c88dd498 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:06.124661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d3782-7ad1-4cd4-b301-941379c4c788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:06.125463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d3782-7ad1-4cd4-b301-941379c4c788 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:06.125810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d3782-7ad1-4cd4-b301-941379c4c788 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:06.126178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d3782-7ad1-4cd4-b301-941379c4c788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:06.150277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886832-f702-4b57-a26a-577119dffbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:06.151382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886832-f702-4b57-a26a-577119dffbb9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:06.151839 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886832-f702-4b57-a26a-577119dffbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:06.152255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886832-f702-4b57-a26a-577119dffbb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:06.164979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de886832-f702-4b57-a26a-577119dffbb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:06.166780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de886832-f702-4b57-a26a-577119dffbb9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:06.184193 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-de886832-f702-4b57-a26a-577119dffbb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:06.185575 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 323/654] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:06.186626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886832-f702-4b57-a26a-577119dffbb9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:06.212938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d3782-7ad1-4cd4-b301-941379c4c788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:06.214875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d3782-7ad1-4cd4-b301-941379c4c788 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:06.287548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886832-f702-4b57-a26a-577119dffbb9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:06.319607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 332/655] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:36:06.321132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d3782-7ad1-4cd4-b301-941379c4c788 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:06.323443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937f85e-288d-466e-9569-a90f3f68914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:06.324325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937f85e-288d-466e-9569-a90f3f68914e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:06.324606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937f85e-288d-466e-9569-a90f3f68914e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:06.324978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937f85e-288d-466e-9569-a90f3f68914e None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:06.326302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937f85e-288d-466e-9569-a90f3f68914e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:06.326302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937f85e-288d-466e-9569-a90f3f68914e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:06.327895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937f85e-288d-466e-9569-a90f3f68914e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:06.350515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 324/656] 10.222.0.26 () {56 vars in 1137 bytes} [Mon Feb 28 21:36:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:06.350515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937f85e-288d-466e-9569-a90f3f68914e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:06.447228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d3782-7ad1-4cd4-b301-941379c4c788 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:06.462462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937f85e-288d-466e-9569-a90f3f68914e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:06.483606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54388678-61ec-4560-8839-deac84f06908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:06.484472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54388678-61ec-4560-8839-deac84f06908 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:06.484891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54388678-61ec-4560-8839-deac84f06908 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:06.485314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54388678-61ec-4560-8839-deac84f06908 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:06.486305 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54388678-61ec-4560-8839-deac84f06908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:06.486743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54388678-61ec-4560-8839-deac84f06908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:06.488270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54388678-61ec-4560-8839-deac84f06908 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:06.498865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13677d90-e5ae-4532-8613-420db2bb7681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:06.499773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13677d90-e5ae-4532-8613-420db2bb7681 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:06.500178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13677d90-e5ae-4532-8613-420db2bb7681 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:06.500571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13677d90-e5ae-4532-8613-420db2bb7681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:06.501549 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 333/657] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:06.502621 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54388678-61ec-4560-8839-deac84f06908 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:06.516913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13677d90-e5ae-4532-8613-420db2bb7681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:06.518542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13677d90-e5ae-4532-8613-420db2bb7681 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:06.536993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-13677d90-e5ae-4532-8613-420db2bb7681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:06.543476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 325/658] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:06.543476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13677d90-e5ae-4532-8613-420db2bb7681 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:06.609315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54388678-61ec-4560-8839-deac84f06908 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:06.643590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf2258-aeac-4e85-851b-03bfa9954f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:06.644461 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf2258-aeac-4e85-851b-03bfa9954f84 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:06.644870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf2258-aeac-4e85-851b-03bfa9954f84 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:06.645283 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf2258-aeac-4e85-851b-03bfa9954f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:06.648411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13677d90-e5ae-4532-8613-420db2bb7681 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:06.684444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146649be-5f0a-4fd2-9434-a316ea1d653b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:06.685631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146649be-5f0a-4fd2-9434-a316ea1d653b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:06.685746 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146649be-5f0a-4fd2-9434-a316ea1d653b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:06.686164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146649be-5f0a-4fd2-9434-a316ea1d653b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:06.694362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146649be-5f0a-4fd2-9434-a316ea1d653b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:06.696575 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146649be-5f0a-4fd2-9434-a316ea1d653b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:06.711642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-146649be-5f0a-4fd2-9434-a316ea1d653b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 28 21:36:06.713034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 326/659] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:06.715215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf2258-aeac-4e85-851b-03bfa9954f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:06.716793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf2258-aeac-4e85-851b-03bfa9954f84 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:06.718132 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146649be-5f0a-4fd2-9434-a316ea1d653b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:06.825444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146649be-5f0a-4fd2-9434-a316ea1d653b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:06.832421 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 334/660] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:36:06.833320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf2258-aeac-4e85-851b-03bfa9954f84 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:06.864946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da125c3a-683e-4959-acdb-bce001ae4e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:06.866271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125c3a-683e-4959-acdb-bce001ae4e68 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:06.866646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125c3a-683e-4959-acdb-bce001ae4e68 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:06.867011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da125c3a-683e-4959-acdb-bce001ae4e68 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:06.867835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da125c3a-683e-4959-acdb-bce001ae4e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:06.868233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da125c3a-683e-4959-acdb-bce001ae4e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:06.869712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da125c3a-683e-4959-acdb-bce001ae4e68 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:06.886317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 327/661] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:06.886317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e2422-5ad6-474d-a1f6-d795e3b2536a None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:06.886317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e2422-5ad6-474d-a1f6-d795e3b2536a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:06.886317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e2422-5ad6-474d-a1f6-d795e3b2536a None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:06.886317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 328/662] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:06.890063 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e2422-5ad6-474d-a1f6-d795e3b2536a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:06.936717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf2258-aeac-4e85-851b-03bfa9954f84 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:06.971613 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29827e-3ede-44a8-8366-66a308dc3c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:06.972285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29827e-3ede-44a8-8366-66a308dc3c1d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:06.972565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29827e-3ede-44a8-8366-66a308dc3c1d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:06.972842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29827e-3ede-44a8-8366-66a308dc3c1d None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:06.973672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29827e-3ede-44a8-8366-66a308dc3c1d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:06.973974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29827e-3ede-44a8-8366-66a308dc3c1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:06.975491 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29827e-3ede-44a8-8366-66a308dc3c1d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:06.992520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e2422-5ad6-474d-a1f6-d795e3b2536a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:06.992687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 335/663] 10.222.0.26 () {56 vars in 1139 bytes} [Mon Feb 28 21:36:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:06.997374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29827e-3ede-44a8-8366-66a308dc3c1d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.030219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f89ae-b489-4de9-a08b-7978d573736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.031158 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f89ae-b489-4de9-a08b-7978d573736a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.031552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f89ae-b489-4de9-a08b-7978d573736a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.031919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f89ae-b489-4de9-a08b-7978d573736a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.043446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f89ae-b489-4de9-a08b-7978d573736a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.045035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f89ae-b489-4de9-a08b-7978d573736a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.062099 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-962f89ae-b489-4de9-a08b-7978d573736a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:07.067924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 329/664] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:07.067924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fb86-bcba-4734-adc5-2e3cb50a8f3c None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.067924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fb86-bcba-4734-adc5-2e3cb50a8f3c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.067924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fb86-bcba-4734-adc5-2e3cb50a8f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.082832 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8fc7fb86-bcba-4734-adc5-2e3cb50a8f3c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:07.084175 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8fc7fb86-bcba-4734-adc5-2e3cb50a8f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:07.099839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29827e-3ede-44a8-8366-66a308dc3c1d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:07.135922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504325d9-32cd-4b67-9f99-650c788d61c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.136637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504325d9-32cd-4b67-9f99-650c788d61c7 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.136936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504325d9-32cd-4b67-9f99-650c788d61c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.137188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504325d9-32cd-4b67-9f99-650c788d61c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.144458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504325d9-32cd-4b67-9f99-650c788d61c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.145900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504325d9-32cd-4b67-9f99-650c788d61c7 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.154243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 330/665] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:07.155253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7fb86-bcba-4734-adc5-2e3cb50a8f3c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.159585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-504325d9-32cd-4b67-9f99-650c788d61c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:07.162112 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 336/666] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:07.162112 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504325d9-32cd-4b67-9f99-650c788d61c7 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.262142 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7fb86-bcba-4734-adc5-2e3cb50a8f3c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:07.266627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504325d9-32cd-4b67-9f99-650c788d61c7 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:07.295481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d14e2c-f9ad-4460-86d5-fc1c9970b765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.296248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d14e2c-f9ad-4460-86d5-fc1c9970b765 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.296443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d14e2c-f9ad-4460-86d5-fc1c9970b765 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.296670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d14e2c-f9ad-4460-86d5-fc1c9970b765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.300667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfad41-4d5d-4568-89bc-6f8a2c5c728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.301314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfad41-4d5d-4568-89bc-6f8a2c5c728d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.301593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfad41-4d5d-4568-89bc-6f8a2c5c728d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.301864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfad41-4d5d-4568-89bc-6f8a2c5c728d None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.302608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfad41-4d5d-4568-89bc-6f8a2c5c728d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:07.302909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfad41-4d5d-4568-89bc-6f8a2c5c728d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.305124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfad41-4d5d-4568-89bc-6f8a2c5c728d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.316343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 337/667] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:07.317125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfad41-4d5d-4568-89bc-6f8a2c5c728d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.365776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d14e2c-f9ad-4460-86d5-fc1c9970b765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.367628 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d14e2c-f9ad-4460-86d5-fc1c9970b765 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.421210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfad41-4d5d-4568-89bc-6f8a2c5c728d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:07.453301 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a8b2f-d400-4365-94d4-38d5d7a3ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.454004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a8b2f-d400-4365-94d4-38d5d7a3ce99 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.454261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a8b2f-d400-4365-94d4-38d5d7a3ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.454530 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a8b2f-d400-4365-94d4-38d5d7a3ce99 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.455300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a8b2f-d400-4365-94d4-38d5d7a3ce99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:07.455599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a8b2f-d400-4365-94d4-38d5d7a3ce99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.457016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a8b2f-d400-4365-94d4-38d5d7a3ce99 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.464055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 331/668] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:36:07.465366 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d14e2c-f9ad-4460-86d5-fc1c9970b765 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.471836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 338/669] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:07.472777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a8b2f-d400-4365-94d4-38d5d7a3ce99 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.570860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d14e2c-f9ad-4460-86d5-fc1c9970b765 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:07.575607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a8b2f-d400-4365-94d4-38d5d7a3ce99 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:07.603106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f5c7-3389-4724-bc37-913fbc36bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.603911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f5c7-3389-4724-bc37-913fbc36bfcd None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.604193 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f5c7-3389-4724-bc37-913fbc36bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.604472 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1f5c7-3389-4724-bc37-913fbc36bfcd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.605105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1f5c7-3389-4724-bc37-913fbc36bfcd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.606481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1f5c7-3389-4724-bc37-913fbc36bfcd None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.608538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50903924-08f6-413a-b401-d979f9b4d34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.609472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903924-08f6-413a-b401-d979f9b4d34e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.609895 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903924-08f6-413a-b401-d979f9b4d34e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.610350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50903924-08f6-413a-b401-d979f9b4d34e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.617220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50903924-08f6-413a-b401-d979f9b4d34e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.618811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50903924-08f6-413a-b401-d979f9b4d34e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.619330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-a3a1f5c7-3389-4724-bc37-913fbc36bfcd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 21:36:07.620527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 332/670] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:07.621279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f5c7-3389-4724-bc37-913fbc36bfcd None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.640870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-50903924-08f6-413a-b401-d979f9b4d34e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:07.642961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 339/671] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:07.644147 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50903924-08f6-413a-b401-d979f9b4d34e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.720163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1f5c7-3389-4724-bc37-913fbc36bfcd None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:07.745242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50903924-08f6-413a-b401-d979f9b4d34e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:07.754321 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d1d8-f8a2-4d4f-b872-e52e6b4f489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.755115 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d1d8-f8a2-4d4f-b872-e52e6b4f489b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.755402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d1d8-f8a2-4d4f-b872-e52e6b4f489b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.755677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1d1d8-f8a2-4d4f-b872-e52e6b4f489b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.767931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1d1d8-f8a2-4d4f-b872-e52e6b4f489b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.769382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1d1d8-f8a2-4d4f-b872-e52e6b4f489b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.778638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7989d-988f-45d9-ad29-ac20c32d060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.779290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7989d-988f-45d9-ad29-ac20c32d060d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.779593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7989d-988f-45d9-ad29-ac20c32d060d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.779842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7989d-988f-45d9-ad29-ac20c32d060d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.780677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7989d-988f-45d9-ad29-ac20c32d060d None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=8182c282a5754f05b4bb6bb7057fa7ab) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:07.780965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7989d-988f-45d9-ad29-ac20c32d060d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.782408 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7989d-988f-45d9-ad29-ac20c32d060d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.785571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-2df1d1d8-f8a2-4d4f-b872-e52e6b4f489b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:07.791290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 333/672] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:07.791290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d1d8-f8a2-4d4f-b872-e52e6b4f489b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.791507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 340/673] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/role_assignments?user.id=8182c282a5754f05b4bb6bb7057fa7ab&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:07.791507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7989d-988f-45d9-ad29-ac20c32d060d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.903401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7989d-988f-45d9-ad29-ac20c32d060d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:07.918041 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1d1d8-f8a2-4d4f-b872-e52e6b4f489b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:07.943138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7a8ba-aa2a-4b51-ae36-85affab48ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.944332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7a8ba-aa2a-4b51-ae36-85affab48ecb None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.944860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7a8ba-aa2a-4b51-ae36-85affab48ecb None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.945442 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7a8ba-aa2a-4b51-ae36-85affab48ecb None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.946517 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7a8ba-aa2a-4b51-ae36-85affab48ecb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:07.947052 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7a8ba-aa2a-4b51-ae36-85affab48ecb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.948787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7a8ba-aa2a-4b51-ae36-85affab48ecb None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.957771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078389-27f6-4fc0-b5d1-0d88e3434de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:07.958427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078389-27f6-4fc0-b5d1-0d88e3434de7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:07.958706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078389-27f6-4fc0-b5d1-0d88e3434de7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:07.958980 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078389-27f6-4fc0-b5d1-0d88e3434de7 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:07.960274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078389-27f6-4fc0-b5d1-0d88e3434de7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:07.960636 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078389-27f6-4fc0-b5d1-0d88e3434de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:07.962513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078389-27f6-4fc0-b5d1-0d88e3434de7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:07.966331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 341/674] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:07.967544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7a8ba-aa2a-4b51-ae36-85affab48ecb None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:07.972349 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 334/675] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:07.973084 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078389-27f6-4fc0-b5d1-0d88e3434de7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:08.094124 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078389-27f6-4fc0-b5d1-0d88e3434de7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:08.095391 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7a8ba-aa2a-4b51-ae36-85affab48ecb None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:08.133867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ed50d-9b57-4b39-a007-c65572f29c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:08.134088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d12124-8f87-4bfa-9cdd-f6f2c869a465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:08.134668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12124-8f87-4bfa-9cdd-f6f2c869a465 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:08.134945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12124-8f87-4bfa-9cdd-f6f2c869a465 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:08.135217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d12124-8f87-4bfa-9cdd-f6f2c869a465 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:08.135638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ed50d-9b57-4b39-a007-c65572f29c7d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:08.136035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d12124-8f87-4bfa-9cdd-f6f2c869a465 None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=500eaf6aadff441ca1e535443e1d8c03) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:08.136317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ed50d-9b57-4b39-a007-c65572f29c7d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:08.136426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d12124-8f87-4bfa-9cdd-f6f2c869a465 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:08.136871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ed50d-9b57-4b39-a007-c65572f29c7d None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:08.137738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d12124-8f87-4bfa-9cdd-f6f2c869a465 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:08.137969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ed50d-9b57-4b39-a007-c65572f29c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:08.138477 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ed50d-9b57-4b39-a007-c65572f29c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:08.140011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ed50d-9b57-4b39-a007-c65572f29c7d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:08.144653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 335/676] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/role_assignments?user.id=500eaf6aadff441ca1e535443e1d8c03&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:08.145449 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d12124-8f87-4bfa-9cdd-f6f2c869a465 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:08.158371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 342/677] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:08.164258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ed50d-9b57-4b39-a007-c65572f29c7d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:08.252059 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d12124-8f87-4bfa-9cdd-f6f2c869a465 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:08.269290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ed50d-9b57-4b39-a007-c65572f29c7d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:08.289690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac1ced-4287-4b39-9e26-44e6c9ad56b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:08.290750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1ced-4287-4b39-9e26-44e6c9ad56b7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:08.291252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1ced-4287-4b39-9e26-44e6c9ad56b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:08.291738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac1ced-4287-4b39-9e26-44e6c9ad56b7 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:08.292671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac1ced-4287-4b39-9e26-44e6c9ad56b7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:08.293167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac1ced-4287-4b39-9e26-44e6c9ad56b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:08.294760 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac1ced-4287-4b39-9e26-44e6c9ad56b7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:08.301210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 336/678] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Feb 28 21:36:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:08.309801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfc538-81c6-44f7-b6d0-738bbffdb032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:08.311186 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfc538-81c6-44f7-b6d0-738bbffdb032 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:08.311660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfc538-81c6-44f7-b6d0-738bbffdb032 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:08.312153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfc538-81c6-44f7-b6d0-738bbffdb032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:08.327348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfc538-81c6-44f7-b6d0-738bbffdb032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:08.329531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfc538-81c6-44f7-b6d0-738bbffdb032 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:08.349159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-11cfc538-81c6-44f7-b6d0-738bbffdb032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:08.351763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 343/679] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:08.357826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac1ced-4287-4b39-9e26-44e6c9ad56b7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:08.412924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98bae7-c59e-423f-82ae-15e1548ab284 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:08.413260 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98bae7-c59e-423f-82ae-15e1548ab284 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:08.413476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98bae7-c59e-423f-82ae-15e1548ab284 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:08.416519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 344/680] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:08.422671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777b04a-1540-4fdc-ba41-b92d3f540fc4 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:08.422671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777b04a-1540-4fdc-ba41-b92d3f540fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:08.422962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777b04a-1540-4fdc-ba41-b92d3f540fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:08.442692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b777b04a-1540-4fdc-ba41-b92d3f540fc4 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:08.444106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b777b04a-1540-4fdc-ba41-b92d3f540fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:08.474689 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac1ced-4287-4b39-9e26-44e6c9ad56b7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:08.512642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b218-4681-4a02-bb78-af4a22c5152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:08.513654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b218-4681-4a02-bb78-af4a22c5152c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:08.514165 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b218-4681-4a02-bb78-af4a22c5152c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:08.514628 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b218-4681-4a02-bb78-af4a22c5152c None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:08.515617 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b218-4681-4a02-bb78-af4a22c5152c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:08.516121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b218-4681-4a02-bb78-af4a22c5152c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:08.517823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b218-4681-4a02-bb78-af4a22c5152c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:08.519474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 345/681] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:36:08.532469 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 337/682] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:08.538568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777b04a-1540-4fdc-ba41-b92d3f540fc4 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:08.545979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b218-4681-4a02-bb78-af4a22c5152c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:08.651075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777b04a-1540-4fdc-ba41-b92d3f540fc4 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:08.666838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b218-4681-4a02-bb78-af4a22c5152c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:08.688453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d07222-9212-4c8d-8007-7e9b6d2e9ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:08.689340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d07222-9212-4c8d-8007-7e9b6d2e9ad3 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:08.689785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d07222-9212-4c8d-8007-7e9b6d2e9ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:08.690230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d07222-9212-4c8d-8007-7e9b6d2e9ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:08.691244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d07222-9212-4c8d-8007-7e9b6d2e9ad3 None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=b4664710493b462bafae3908c582e9bc) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:08.691736 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d07222-9212-4c8d-8007-7e9b6d2e9ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:08.693279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d07222-9212-4c8d-8007-7e9b6d2e9ad3 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:08.701146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 346/683] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:08 2022] GET /identity/v3/role_assignments?user.id=b4664710493b462bafae3908c582e9bc&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:08.706128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05072b9e-6e4c-4f59-bd78-794ebb2fe791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:08.706894 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072b9e-6e4c-4f59-bd78-794ebb2fe791 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:08.707168 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072b9e-6e4c-4f59-bd78-794ebb2fe791 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:08.707438 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072b9e-6e4c-4f59-bd78-794ebb2fe791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:08.720319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05072b9e-6e4c-4f59-bd78-794ebb2fe791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:08.727677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-05072b9e-6e4c-4f59-bd78-794ebb2fe791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:36:08.729336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 338/684] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:08.735952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d07222-9212-4c8d-8007-7e9b6d2e9ad3 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:08.851395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d07222-9212-4c8d-8007-7e9b6d2e9ad3 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:08.895419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954f2fe-c4b2-48f4-8390-52f87c0db5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:08.896108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954f2fe-c4b2-48f4-8390-52f87c0db5ad None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:08.896384 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954f2fe-c4b2-48f4-8390-52f87c0db5ad None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:08.896681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954f2fe-c4b2-48f4-8390-52f87c0db5ad None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:08.897472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954f2fe-c4b2-48f4-8390-52f87c0db5ad None admin] RBAC: Adding query filter params (name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:08.897862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954f2fe-c4b2-48f4-8390-52f87c0db5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:08.899245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954f2fe-c4b2-48f4-8390-52f87c0db5ad None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:08.908164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 347/685] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:08.914310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05072b9e-6e4c-4f59-bd78-794ebb2fe791 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:09.015135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05072b9e-6e4c-4f59-bd78-794ebb2fe791 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:09.054170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536b532-1b53-41d1-845e-a406f32e2279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:09.054974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536b532-1b53-41d1-845e-a406f32e2279 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:09.055311 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536b532-1b53-41d1-845e-a406f32e2279 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:09.055584 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536b532-1b53-41d1-845e-a406f32e2279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:09.067766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536b532-1b53-41d1-845e-a406f32e2279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:09.069754 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536b532-1b53-41d1-845e-a406f32e2279 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:09.087294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-b536b532-1b53-41d1-845e-a406f32e2279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:09.088919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 339/686] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:09.094222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954f2fe-c4b2-48f4-8390-52f87c0db5ad None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:09.200997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954f2fe-c4b2-48f4-8390-52f87c0db5ad None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:09.244321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd7c47-1c75-4f7f-947f-f53eda79cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:09.244998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd7c47-1c75-4f7f-947f-f53eda79cb5e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:09.245277 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd7c47-1c75-4f7f-947f-f53eda79cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:09.245551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd7c47-1c75-4f7f-947f-f53eda79cb5e None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:09.246295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd7c47-1c75-4f7f-947f-f53eda79cb5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:09.246599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd7c47-1c75-4f7f-947f-f53eda79cb5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:09.247947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd7c47-1c75-4f7f-947f-f53eda79cb5e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:09.268942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 348/687] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:09.275072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536b532-1b53-41d1-845e-a406f32e2279 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:09.409618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536b532-1b53-41d1-845e-a406f32e2279 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:09.452625 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72f6fd-11a7-4af0-b599-a88e7c31b5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:09.453816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72f6fd-11a7-4af0-b599-a88e7c31b5ad None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:09.454315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72f6fd-11a7-4af0-b599-a88e7c31b5ad None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:09.454780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72f6fd-11a7-4af0-b599-a88e7c31b5ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:09.468018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72f6fd-11a7-4af0-b599-a88e7c31b5ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:09.469708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72f6fd-11a7-4af0-b599-a88e7c31b5ad None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:09.485813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-2d72f6fd-11a7-4af0-b599-a88e7c31b5ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 21:36:09.488129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 340/688] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:09.494059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd7c47-1c75-4f7f-947f-f53eda79cb5e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:09.642360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd7c47-1c75-4f7f-947f-f53eda79cb5e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:09.692380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1dad4-df13-40c1-bb13-24647e2789a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:09.693077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1dad4-df13-40c1-bb13-24647e2789a1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:09.693356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1dad4-df13-40c1-bb13-24647e2789a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:09.694252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1dad4-df13-40c1-bb13-24647e2789a1 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:09.695138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1dad4-df13-40c1-bb13-24647e2789a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:09.695443 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1dad4-df13-40c1-bb13-24647e2789a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:09.696897 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1dad4-df13-40c1-bb13-24647e2789a1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:09.721789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 349/689] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Feb 28 21:36:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:09.728044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72f6fd-11a7-4af0-b599-a88e7c31b5ad None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:09.961018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72f6fd-11a7-4af0-b599-a88e7c31b5ad None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:10.002268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedb1ce-55ae-490c-b083-dc557d6fddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:10.003254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedb1ce-55ae-490c-b083-dc557d6fddc6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:10.003728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedb1ce-55ae-490c-b083-dc557d6fddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:10.004191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedb1ce-55ae-490c-b083-dc557d6fddc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:10.071039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedb1ce-55ae-490c-b083-dc557d6fddc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:10.072826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedb1ce-55ae-490c-b083-dc557d6fddc6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:10.200648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 341/690] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:36:10.206314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1dad4-df13-40c1-bb13-24647e2789a1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:10.362730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1dad4-df13-40c1-bb13-24647e2789a1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:10.407561 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28e9b6-1f00-4d93-82de-a3c7ef122625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:10.408364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28e9b6-1f00-4d93-82de-a3c7ef122625 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:10.408645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28e9b6-1f00-4d93-82de-a3c7ef122625 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:10.408917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28e9b6-1f00-4d93-82de-a3c7ef122625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:10.425719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28e9b6-1f00-4d93-82de-a3c7ef122625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:10.427542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28e9b6-1f00-4d93-82de-a3c7ef122625 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:10.448079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-bb28e9b6-1f00-4d93-82de-a3c7ef122625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:10.449606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 350/691] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:10.457070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedb1ce-55ae-490c-b083-dc557d6fddc6 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:10.579248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedb1ce-55ae-490c-b083-dc557d6fddc6 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:10.584938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b446a-b772-443f-b987-9e70b087d0c0 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:10.585214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b446a-b772-443f-b987-9e70b087d0c0 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:10.585494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b446a-b772-443f-b987-9e70b087d0c0 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:10.587597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 351/692] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:10.592655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f934-e376-4206-98e3-86341f0c6815 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:10.592939 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f934-e376-4206-98e3-86341f0c6815 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:10.593216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f934-e376-4206-98e3-86341f0c6815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:10.619646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa88fae-faa8-4f39-a14a-1d6a3466d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:10.620232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa88fae-faa8-4f39-a14a-1d6a3466d452 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:10.620502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa88fae-faa8-4f39-a14a-1d6a3466d452 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:10.620769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa88fae-faa8-4f39-a14a-1d6a3466d452 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:10.621482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa88fae-faa8-4f39-a14a-1d6a3466d452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:10.621782 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa88fae-faa8-4f39-a14a-1d6a3466d452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:10.623169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa88fae-faa8-4f39-a14a-1d6a3466d452 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:10.625436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2c63f934-e376-4206-98e3-86341f0c6815 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:10.626646 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2c63f934-e376-4206-98e3-86341f0c6815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:10.639398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 342/693] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:10.645844 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa88fae-faa8-4f39-a14a-1d6a3466d452 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:10.752728 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 352/694] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Feb 28 21:36:10.776946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63f934-e376-4206-98e3-86341f0c6815 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:10.810738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa88fae-faa8-4f39-a14a-1d6a3466d452 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:10.890806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaceb1-2017-4eda-9f00-05ab58b210d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:10.891532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaceb1-2017-4eda-9f00-05ab58b210d1 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:10.891821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaceb1-2017-4eda-9f00-05ab58b210d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:10.892099 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaceb1-2017-4eda-9f00-05ab58b210d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:10.899614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaceb1-2017-4eda-9f00-05ab58b210d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:10.901050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaceb1-2017-4eda-9f00-05ab58b210d1 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:10.908555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63f934-e376-4206-98e3-86341f0c6815 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:10.915154 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-8dbaceb1-2017-4eda-9f00-05ab58b210d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:10.920857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 343/695] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:10.922266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaceb1-2017-4eda-9f00-05ab58b210d1 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:10.956312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd8feb-8f1d-4a51-93dc-61e8e4092b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:10.957122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd8feb-8f1d-4a51-93dc-61e8e4092b9f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:10.957406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd8feb-8f1d-4a51-93dc-61e8e4092b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:10.957679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd8feb-8f1d-4a51-93dc-61e8e4092b9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:10.976343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd8feb-8f1d-4a51-93dc-61e8e4092b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:10.994924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-88dd8feb-8f1d-4a51-93dc-61e8e4092b9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:36:11.004366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 353/696] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:11.005272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd8feb-8f1d-4a51-93dc-61e8e4092b9f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:11.101153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaceb1-2017-4eda-9f00-05ab58b210d1 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:11.167612 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ed034-e696-49ef-97ba-82e6ba7fda8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:11.168976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed034-e696-49ef-97ba-82e6ba7fda8e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.169270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed034-e696-49ef-97ba-82e6ba7fda8e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.169548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ed034-e696-49ef-97ba-82e6ba7fda8e None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.171081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ed034-e696-49ef-97ba-82e6ba7fda8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:11.171558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ed034-e696-49ef-97ba-82e6ba7fda8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:11.174178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ed034-e696-49ef-97ba-82e6ba7fda8e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:11.195831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 344/697] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:11.197920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56db2de-fa5f-4ec8-aa27-05d4ae2716a7 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.198520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56db2de-fa5f-4ec8-aa27-05d4ae2716a7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.198806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56db2de-fa5f-4ec8-aa27-05d4ae2716a7 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.205668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 345/698] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:11.207549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56db2de-fa5f-4ec8-aa27-05d4ae2716a7 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:11.268272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd8feb-8f1d-4a51-93dc-61e8e4092b9f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:11.338455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e791bd2-eb29-412d-bf51-8d6848120530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:11.339131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791bd2-eb29-412d-bf51-8d6848120530 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.339407 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791bd2-eb29-412d-bf51-8d6848120530 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.339677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791bd2-eb29-412d-bf51-8d6848120530 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.340421 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e791bd2-eb29-412d-bf51-8d6848120530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:11.348026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e791bd2-eb29-412d-bf51-8d6848120530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:11.348026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e791bd2-eb29-412d-bf51-8d6848120530 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:11.355070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56db2de-fa5f-4ec8-aa27-05d4ae2716a7 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:11.370014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 354/699] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:11.370014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650733-773e-4694-9adf-c408fa7f1393 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.370898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650733-773e-4694-9adf-c408fa7f1393 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.370898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650733-773e-4694-9adf-c408fa7f1393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.400653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2f40-5164-41b8-b25f-4317326687f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:11.406017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2f40-5164-41b8-b25f-4317326687f1 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.406017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2f40-5164-41b8-b25f-4317326687f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.406017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2f40-5164-41b8-b25f-4317326687f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.406017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2f40-5164-41b8-b25f-4317326687f1 None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=368937ee42184e31b346ab9db570c122) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:11.406017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2f40-5164-41b8-b25f-4317326687f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:11.406017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2f40-5164-41b8-b25f-4317326687f1 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:11.422102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 346/700] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:11 2022] GET /identity/v3/role_assignments?user.id=368937ee42184e31b346ab9db570c122&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:11.422102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2f40-5164-41b8-b25f-4317326687f1 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:11.432662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-74650733-773e-4694-9adf-c408fa7f1393 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:11.436451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-74650733-773e-4694-9adf-c408fa7f1393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:11.590643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2f40-5164-41b8-b25f-4317326687f1 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:11.637551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e049075-1b5b-44eb-a0cb-f25aa62fdcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:11.638090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 355/701] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:11.638404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e049075-1b5b-44eb-a0cb-f25aa62fdcc0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.638687 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e049075-1b5b-44eb-a0cb-f25aa62fdcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.638962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e049075-1b5b-44eb-a0cb-f25aa62fdcc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.639746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bcc19-8cc4-49b6-b14c-40235898cd1e None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.640037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bcc19-8cc4-49b6-b14c-40235898cd1e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.640316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bcc19-8cc4-49b6-b14c-40235898cd1e None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.642438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 356/702] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:11.649576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ad839-e852-4194-83ef-7beb29590e20 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.649861 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ad839-e852-4194-83ef-7beb29590e20 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.650165 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ad839-e852-4194-83ef-7beb29590e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.658366 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e049075-1b5b-44eb-a0cb-f25aa62fdcc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:11.659835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e049075-1b5b-44eb-a0cb-f25aa62fdcc0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:11.676053 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2d6ad839-e852-4194-83ef-7beb29590e20 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:11.677152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2d6ad839-e852-4194-83ef-7beb29590e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:11.684648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-7e049075-1b5b-44eb-a0cb-f25aa62fdcc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:11.685905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 347/703] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:11.686695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e049075-1b5b-44eb-a0cb-f25aa62fdcc0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:11.759826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 357/704] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:11.760688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ad839-e852-4194-83ef-7beb29590e20 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:11.809899 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e049075-1b5b-44eb-a0cb-f25aa62fdcc0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:11.845253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2d172-4680-4621-a954-ea4befd6aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:11.845921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d172-4680-4621-a954-ea4befd6aee9 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.846223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d172-4680-4621-a954-ea4befd6aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.846503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2d172-4680-4621-a954-ea4befd6aee9 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.847227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2d172-4680-4621-a954-ea4befd6aee9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:11.848608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2d172-4680-4621-a954-ea4befd6aee9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:11.876089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ad839-e852-4194-83ef-7beb29590e20 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:11.909263 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f77ab-e8dd-483e-8a1a-925f61abdb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:11.909929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f77ab-e8dd-483e-8a1a-925f61abdb6c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.910241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f77ab-e8dd-483e-8a1a-925f61abdb6c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.910516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f77ab-e8dd-483e-8a1a-925f61abdb6c None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.911231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f77ab-e8dd-483e-8a1a-925f61abdb6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:11.911535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f77ab-e8dd-483e-8a1a-925f61abdb6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:11.913662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f77ab-e8dd-483e-8a1a-925f61abdb6c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:11.924760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 358/705] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:11.925565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f77ab-e8dd-483e-8a1a-925f61abdb6c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:11.954111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 348/706] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:36:11 2022] POST /identity/v3/services => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:11.954111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09296-6988-4783-850e-d1adefd3f630 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:11.954111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09296-6988-4783-850e-d1adefd3f630 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:11.954111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e09296-6988-4783-850e-d1adefd3f630 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:11.954111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 349/707] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:11.954111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e09296-6988-4783-850e-d1adefd3f630 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:12.045646 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f77ab-e8dd-483e-8a1a-925f61abdb6c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:12.093674 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f47d9-af29-4ac9-83cd-4f1ef1b33a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:12.094644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f47d9-af29-4ac9-83cd-4f1ef1b33a9d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:12.094925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e09296-6988-4783-850e-d1adefd3f630 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:12.095032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f47d9-af29-4ac9-83cd-4f1ef1b33a9d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:12.095392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f47d9-af29-4ac9-83cd-4f1ef1b33a9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:12.110686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f47d9-af29-4ac9-83cd-4f1ef1b33a9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:12.112331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f47d9-af29-4ac9-83cd-4f1ef1b33a9d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:12.131218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-4b3f47d9-af29-4ac9-83cd-4f1ef1b33a9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:12.135551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3f9bf-52ec-41f6-928b-30a941b020da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:12.136608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f9bf-52ec-41f6-928b-30a941b020da None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:12.137090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f9bf-52ec-41f6-928b-30a941b020da None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:12.137531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3f9bf-52ec-41f6-928b-30a941b020da None admin] PATH_INFO: `/v3/users/nova` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:12.137863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 359/708] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:12.139477 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc360a-2711-4373-a568-1186891be2db None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:12.139769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc360a-2711-4373-a568-1186891be2db None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:12.140050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc360a-2711-4373-a568-1186891be2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:12.147967 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3f9bf-52ec-41f6-928b-30a941b020da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:12.149684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3f9bf-52ec-41f6-928b-30a941b020da None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:12.159718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-09dc360a-2711-4373-a568-1186891be2db None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:12.160919 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-09dc360a-2711-4373-a568-1186891be2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:12.168992 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-38d3f9bf-52ec-41f6-928b-30a941b020da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 21:36:12.170538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 350/709] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Feb 28 21:36:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:12.171533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3f9bf-52ec-41f6-928b-30a941b020da None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:12.241192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 360/710] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:12.242012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc360a-2711-4373-a568-1186891be2db None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:12.301418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3f9bf-52ec-41f6-928b-30a941b020da None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:12.345644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8900d-1b3f-4f9e-bbad-015d4ee90d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:12.347199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8900d-1b3f-4f9e-bbad-015d4ee90d1c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:12.347666 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8900d-1b3f-4f9e-bbad-015d4ee90d1c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:12.348293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8900d-1b3f-4f9e-bbad-015d4ee90d1c None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:12.349562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8900d-1b3f-4f9e-bbad-015d4ee90d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:12.350490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8900d-1b3f-4f9e-bbad-015d4ee90d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:12.353121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8900d-1b3f-4f9e-bbad-015d4ee90d1c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:12.359468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc360a-2711-4373-a568-1186891be2db None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:12.370034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 351/711] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:12.370034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8900d-1b3f-4f9e-bbad-015d4ee90d1c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:12.402587 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0b31f-c04c-46f6-a173-a1e777f81f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:12.403536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0b31f-c04c-46f6-a173-a1e777f81f11 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:12.404006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0b31f-c04c-46f6-a173-a1e777f81f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:12.404414 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0b31f-c04c-46f6-a173-a1e777f81f11 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:12.405417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0b31f-c04c-46f6-a173-a1e777f81f11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:12.405915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0b31f-c04c-46f6-a173-a1e777f81f11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:12.407534 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0b31f-c04c-46f6-a173-a1e777f81f11 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:12.425927 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 361/712] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Feb 28 21:36:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:12.430767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0b31f-c04c-46f6-a173-a1e777f81f11 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:12.476334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8900d-1b3f-4f9e-bbad-015d4ee90d1c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:12.511582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45478a-fdaa-48cf-b916-1144a68294e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:12.512334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45478a-fdaa-48cf-b916-1144a68294e7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:12.512615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45478a-fdaa-48cf-b916-1144a68294e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:12.512888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45478a-fdaa-48cf-b916-1144a68294e7 None admin] PATH_INFO: `/v3/services/network` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:12.513545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45478a-fdaa-48cf-b916-1144a68294e7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:12.514936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45478a-fdaa-48cf-b916-1144a68294e7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:12.526181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-3b45478a-fdaa-48cf-b916-1144a68294e7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 21:36:12.527675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 352/713] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:12 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:12.528470 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45478a-fdaa-48cf-b916-1144a68294e7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:12.531929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0b31f-c04c-46f6-a173-a1e777f81f11 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:12.566541 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb59566-693a-4f56-ab78-e2074bd61c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:12.567219 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb59566-693a-4f56-ab78-e2074bd61c1f None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:12.567498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb59566-693a-4f56-ab78-e2074bd61c1f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:12.567774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb59566-693a-4f56-ab78-e2074bd61c1f None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:12.568508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb59566-693a-4f56-ab78-e2074bd61c1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:12.570152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb59566-693a-4f56-ab78-e2074bd61c1f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:12.626892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45478a-fdaa-48cf-b916-1144a68294e7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:12.654078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 362/714] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:36:12 2022] POST /identity/v3/users => generated 254 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:12.655398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb59566-693a-4f56-ab78-e2074bd61c1f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:12.675784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23670c3-711d-4792-98ae-6a734ffe66ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:12.680071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23670c3-711d-4792-98ae-6a734ffe66ca None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:12.681283 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23670c3-711d-4792-98ae-6a734ffe66ca None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:12.681763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23670c3-711d-4792-98ae-6a734ffe66ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:12.818929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23670c3-711d-4792-98ae-6a734ffe66ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:12.820422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23670c3-711d-4792-98ae-6a734ffe66ca None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:12.869428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb59566-693a-4f56-ab78-e2074bd61c1f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:12.919890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157adfd-b5bc-4829-b5b9-b51a8963bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:12.920580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157adfd-b5bc-4829-b5b9-b51a8963bf58 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:12.920864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157adfd-b5bc-4829-b5b9-b51a8963bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:12.921143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157adfd-b5bc-4829-b5b9-b51a8963bf58 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:12.921875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157adfd-b5bc-4829-b5b9-b51a8963bf58 None admin] RBAC: Adding query filter params (name=network) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:12.922408 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157adfd-b5bc-4829-b5b9-b51a8963bf58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:12.924395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157adfd-b5bc-4829-b5b9-b51a8963bf58 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:12.931714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 363/715] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:12.937891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157adfd-b5bc-4829-b5b9-b51a8963bf58 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:12.960122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 353/716] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:12 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:36:12.965477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23670c3-711d-4792-98ae-6a734ffe66ca None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:13.062048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157adfd-b5bc-4829-b5b9-b51a8963bf58 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:13.087591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23670c3-711d-4792-98ae-6a734ffe66ca None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:13.109204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561911a-1b96-467c-a320-dcb3500d5027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:13.109882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561911a-1b96-467c-a320-dcb3500d5027 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:13.110654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561911a-1b96-467c-a320-dcb3500d5027 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:13.110944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561911a-1b96-467c-a320-dcb3500d5027 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:13.111948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561911a-1b96-467c-a320-dcb3500d5027 None admin] RBAC: Adding query filter params (type=network) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:13.112257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561911a-1b96-467c-a320-dcb3500d5027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:13.113806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561911a-1b96-467c-a320-dcb3500d5027 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:13.123287 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 364/717] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:13.126045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9474afe-8e94-4640-8b29-1c2c152559d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:13.127036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474afe-8e94-4640-8b29-1c2c152559d0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:13.127319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474afe-8e94-4640-8b29-1c2c152559d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:13.127592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474afe-8e94-4640-8b29-1c2c152559d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:13.141601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9474afe-8e94-4640-8b29-1c2c152559d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:13.143127 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9474afe-8e94-4640-8b29-1c2c152559d0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:13.162454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-a9474afe-8e94-4640-8b29-1c2c152559d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:13.164206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 354/718] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:13.169844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561911a-1b96-467c-a320-dcb3500d5027 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:13.297273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561911a-1b96-467c-a320-dcb3500d5027 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:13.335399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ffe0e-a25a-4afd-bf55-677e4dc517e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:13.336073 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ffe0e-a25a-4afd-bf55-677e4dc517e8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:13.336360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ffe0e-a25a-4afd-bf55-677e4dc517e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:13.336627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ffe0e-a25a-4afd-bf55-677e4dc517e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:13.337351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ffe0e-a25a-4afd-bf55-677e4dc517e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:13.337697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ffe0e-a25a-4afd-bf55-677e4dc517e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:13.339057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ffe0e-a25a-4afd-bf55-677e4dc517e8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:13.353215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 365/719] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:13.358654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9474afe-8e94-4640-8b29-1c2c152559d0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:13.467709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9474afe-8e94-4640-8b29-1c2c152559d0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:13.520073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558be69-2c79-40e3-a326-1ec05521d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:13.520876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558be69-2c79-40e3-a326-1ec05521d949 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:13.521157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558be69-2c79-40e3-a326-1ec05521d949 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:13.521567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558be69-2c79-40e3-a326-1ec05521d949 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:13.531088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558be69-2c79-40e3-a326-1ec05521d949 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:13.532545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558be69-2c79-40e3-a326-1ec05521d949 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:13.549663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-3558be69-2c79-40e3-a326-1ec05521d949 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:13.551189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 355/720] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:13.557021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ffe0e-a25a-4afd-bf55-677e4dc517e8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:13.749306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ffe0e-a25a-4afd-bf55-677e4dc517e8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:13.796663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714af19-f343-4458-9df5-c7a19c22e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:13.797340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714af19-f343-4458-9df5-c7a19c22e038 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:13.797619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714af19-f343-4458-9df5-c7a19c22e038 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:13.802011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714af19-f343-4458-9df5-c7a19c22e038 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:13.802011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714af19-f343-4458-9df5-c7a19c22e038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:13.802011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714af19-f343-4458-9df5-c7a19c22e038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:13.802011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714af19-f343-4458-9df5-c7a19c22e038 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:13.822083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 366/721] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:13.827099 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558be69-2c79-40e3-a326-1ec05521d949 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:13.982104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558be69-2c79-40e3-a326-1ec05521d949 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:14.038794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f138d2-d7de-47d3-9b8c-d8d39fd64c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:14.039788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f138d2-d7de-47d3-9b8c-d8d39fd64c87 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:14.040277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f138d2-d7de-47d3-9b8c-d8d39fd64c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:14.040743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f138d2-d7de-47d3-9b8c-d8d39fd64c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:14.041884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f138d2-d7de-47d3-9b8c-d8d39fd64c87 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=8182c282a5754f05b4bb6bb7057fa7ab) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:14.042440 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f138d2-d7de-47d3-9b8c-d8d39fd64c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:14.044057 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f138d2-d7de-47d3-9b8c-d8d39fd64c87 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:14.050377 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 356/722] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:13 2022] GET /identity/v3/role_assignments?user.id=8182c282a5754f05b4bb6bb7057fa7ab&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:14.298079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b8f8e-5c05-4a80-bc17-65b3b5112a6c None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:14.298557 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b8f8e-5c05-4a80-bc17-65b3b5112a6c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:14.298557 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b8f8e-5c05-4a80-bc17-65b3b5112a6c None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:14.300532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 367/723] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:14.306177 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4797d-9df4-4859-a720-43ed420ebc46 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:14.306712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4797d-9df4-4859-a720-43ed420ebc46 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:14.307202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4797d-9df4-4859-a720-43ed420ebc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:14.326598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f1e4797d-9df4-4859-a720-43ed420ebc46 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:14.328102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f1e4797d-9df4-4859-a720-43ed420ebc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:14.423355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 357/724] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:14.459351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b8f8e-5c05-4a80-bc17-65b3b5112a6c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:14.584525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b8f8e-5c05-4a80-bc17-65b3b5112a6c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:14.626466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082a70d-95ed-4e84-af46-cadee7d4052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:14.627285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a70d-95ed-4e84-af46-cadee7d4052d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:14.627565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a70d-95ed-4e84-af46-cadee7d4052d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:14.627834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082a70d-95ed-4e84-af46-cadee7d4052d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:14.645971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082a70d-95ed-4e84-af46-cadee7d4052d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:14.654251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-e082a70d-95ed-4e84-af46-cadee7d4052d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:36:14.655870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 368/725] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:14.661524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4797d-9df4-4859-a720-43ed420ebc46 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:14.800334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4797d-9df4-4859-a720-43ed420ebc46 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:14.802043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99e62-ed5e-4597-bf0c-0d897743b17a None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:14.802324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99e62-ed5e-4597-bf0c-0d897743b17a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:14.805453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc99e62-ed5e-4597-bf0c-0d897743b17a None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:14.805453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 369/726] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:14.810311 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992859df-bd80-4b4c-a39d-9389fab538e1 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:14.810834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992859df-bd80-4b4c-a39d-9389fab538e1 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:14.811296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992859df-bd80-4b4c-a39d-9389fab538e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:14.846308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-992859df-bd80-4b4c-a39d-9389fab538e1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:14.847797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-992859df-bd80-4b4c-a39d-9389fab538e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:14.861964 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd388b6-06ee-4024-bc95-877e3447ea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:14.861964 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd388b6-06ee-4024-bc95-877e3447ea8d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:14.861964 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd388b6-06ee-4024-bc95-877e3447ea8d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:14.861964 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd388b6-06ee-4024-bc95-877e3447ea8d None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:14.862616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd388b6-06ee-4024-bc95-877e3447ea8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:14.862616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd388b6-06ee-4024-bc95-877e3447ea8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:14.862616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd388b6-06ee-4024-bc95-877e3447ea8d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:14.871598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 358/727] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:14.877687 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd388b6-06ee-4024-bc95-877e3447ea8d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:14.988262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 370/728] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:15.023153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992859df-bd80-4b4c-a39d-9389fab538e1 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:15.048109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd388b6-06ee-4024-bc95-877e3447ea8d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:15.094637 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161b506-1f7e-4164-a07e-17a8aee03d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:15.095493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161b506-1f7e-4164-a07e-17a8aee03d3f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:15.095779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161b506-1f7e-4164-a07e-17a8aee03d3f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:15.096055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161b506-1f7e-4164-a07e-17a8aee03d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:15.108580 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161b506-1f7e-4164-a07e-17a8aee03d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:15.109951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161b506-1f7e-4164-a07e-17a8aee03d3f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:15.127565 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-0161b506-1f7e-4164-a07e-17a8aee03d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:15.129056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 359/729] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:15.138962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161b506-1f7e-4164-a07e-17a8aee03d3f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:15.219185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992859df-bd80-4b4c-a39d-9389fab538e1 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:15.280447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb3a75-bb7e-48de-beff-c09de3e763db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:15.281286 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3a75-bb7e-48de-beff-c09de3e763db None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:15.281767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3a75-bb7e-48de-beff-c09de3e763db None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:15.282073 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb3a75-bb7e-48de-beff-c09de3e763db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:15.283227 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb3a75-bb7e-48de-beff-c09de3e763db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:15.285060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb3a75-bb7e-48de-beff-c09de3e763db None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:15.307108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-8fcb3a75-bb7e-48de-beff-c09de3e763db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 21:36:15.308333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 371/730] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Feb 28 21:36:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:15.316363 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161b506-1f7e-4164-a07e-17a8aee03d3f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:15.318446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb3a75-bb7e-48de-beff-c09de3e763db None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:15.376673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c52a82-7594-4bf7-9789-789766700306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:15.377311 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c52a82-7594-4bf7-9789-789766700306 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:15.377590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c52a82-7594-4bf7-9789-789766700306 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:15.377863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c52a82-7594-4bf7-9789-789766700306 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:15.378603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c52a82-7594-4bf7-9789-789766700306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:15.378899 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c52a82-7594-4bf7-9789-789766700306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:15.380259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c52a82-7594-4bf7-9789-789766700306 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:15.401753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 360/731] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:15.407393 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c52a82-7594-4bf7-9789-789766700306 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:15.453602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb3a75-bb7e-48de-beff-c09de3e763db None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:15.487589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6bd4e-a14b-463f-92e0-ceff4676ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:15.488262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6bd4e-a14b-463f-92e0-ceff4676ead1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:15.488541 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6bd4e-a14b-463f-92e0-ceff4676ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:15.488812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6bd4e-a14b-463f-92e0-ceff4676ead1 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:15.489524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6bd4e-a14b-463f-92e0-ceff4676ead1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:15.489823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6bd4e-a14b-463f-92e0-ceff4676ead1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:15.493647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6bd4e-a14b-463f-92e0-ceff4676ead1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:15.500189 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 372/732] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Feb 28 21:36:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:15.506873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6bd4e-a14b-463f-92e0-ceff4676ead1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:15.617455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6bd4e-a14b-463f-92e0-ceff4676ead1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:15.628932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c52a82-7594-4bf7-9789-789766700306 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:15.661537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc01db-278d-4d93-991e-d89d229c9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:15.662414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c744f7-6eee-4108-b0c9-a7f8fde91cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:15.663208 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c744f7-6eee-4108-b0c9-a7f8fde91cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:15.663490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c744f7-6eee-4108-b0c9-a7f8fde91cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:15.663760 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c744f7-6eee-4108-b0c9-a7f8fde91cc1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:15.664186 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc01db-278d-4d93-991e-d89d229c9148 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:15.664801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc01db-278d-4d93-991e-d89d229c9148 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:15.665246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc01db-278d-4d93-991e-d89d229c9148 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:15.666330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc01db-278d-4d93-991e-d89d229c9148 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:15.667284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc01db-278d-4d93-991e-d89d229c9148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:15.668830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc01db-278d-4d93-991e-d89d229c9148 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:15.671346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c744f7-6eee-4108-b0c9-a7f8fde91cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:15.672730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c744f7-6eee-4108-b0c9-a7f8fde91cc1 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:15.675840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 373/733] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Feb 28 21:36:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:15.677330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0a6a0-303c-4236-9bbc-683769df5b7a None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:15.678474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0a6a0-303c-4236-9bbc-683769df5b7a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:15.678915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0a6a0-303c-4236-9bbc-683769df5b7a None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:15.685004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 374/734] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:15.686131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0a6a0-303c-4236-9bbc-683769df5b7a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:15.692768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-91c744f7-6eee-4108-b0c9-a7f8fde91cc1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 21:36:15.694663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 361/735] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:15.699251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb75f-626b-4744-aeb2-15055c9ab298 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:15.699251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb75f-626b-4744-aeb2-15055c9ab298 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:15.699251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb75f-626b-4744-aeb2-15055c9ab298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:15.715153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-befcb75f-626b-4744-aeb2-15055c9ab298 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:15.716493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-befcb75f-626b-4744-aeb2-15055c9ab298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:15.794014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 362/736] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:15.794014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcb75f-626b-4744-aeb2-15055c9ab298 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:15.837585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0a6a0-303c-4236-9bbc-683769df5b7a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:15.878094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b375854-ef06-4e4b-8e3e-26f988c5ec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:15.879174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b375854-ef06-4e4b-8e3e-26f988c5ec20 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:15.879174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b375854-ef06-4e4b-8e3e-26f988c5ec20 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:15.879347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b375854-ef06-4e4b-8e3e-26f988c5ec20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:15.880276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b375854-ef06-4e4b-8e3e-26f988c5ec20 None admin] RBAC: Adding query filter params (interface=public, service_id=e1361e663a204aa38600c6840557e91d, region_id=RegionOne) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:15.880647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b375854-ef06-4e4b-8e3e-26f988c5ec20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:15.882091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b375854-ef06-4e4b-8e3e-26f988c5ec20 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:15.895046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 375/737] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Feb 28 21:36:15 2022] GET /identity/v3/endpoints?service_id=e1361e663a204aa38600c6840557e91d&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:15.897206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b375854-ef06-4e4b-8e3e-26f988c5ec20 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:15.934147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcb75f-626b-4744-aeb2-15055c9ab298 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:15.979673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bd434-6061-48bb-a0b4-f314c097b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:15.980347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bd434-6061-48bb-a0b4-f314c097b1a0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:15.980621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bd434-6061-48bb-a0b4-f314c097b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:15.980888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bd434-6061-48bb-a0b4-f314c097b1a0 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:15.981717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bd434-6061-48bb-a0b4-f314c097b1a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:15.982041 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bd434-6061-48bb-a0b4-f314c097b1a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:15.983549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bd434-6061-48bb-a0b4-f314c097b1a0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:16.005464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 363/738] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Feb 28 21:36:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:16.005464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bd434-6061-48bb-a0b4-f314c097b1a0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:16.009354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b375854-ef06-4e4b-8e3e-26f988c5ec20 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:16.055040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9083e98-eaef-463f-b849-07e7483d47ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:16.056505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9083e98-eaef-463f-b849-07e7483d47ff None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.056993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9083e98-eaef-463f-b849-07e7483d47ff None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.057486 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9083e98-eaef-463f-b849-07e7483d47ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.071279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9083e98-eaef-463f-b849-07e7483d47ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:16.080905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-d9083e98-eaef-463f-b849-07e7483d47ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:36:16.087990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 376/739] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:16.087990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9083e98-eaef-463f-b849-07e7483d47ff None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:16.110325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bd434-6061-48bb-a0b4-f314c097b1a0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:16.144853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edb91d-f8a7-469b-aef3-683e375d633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:16.145434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edb91d-f8a7-469b-aef3-683e375d633b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.145712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edb91d-f8a7-469b-aef3-683e375d633b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.146000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edb91d-f8a7-469b-aef3-683e375d633b None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.147486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edb91d-f8a7-469b-aef3-683e375d633b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:16.148849 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edb91d-f8a7-469b-aef3-683e375d633b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:16.153687 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 364/740] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Feb 28 21:36:16 2022] GET /identity/v3/services => generated 544 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:16.154792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca507381-6c86-41fc-a462-8c42af7d3dac None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.155072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca507381-6c86-41fc-a462-8c42af7d3dac None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.155344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca507381-6c86-41fc-a462-8c42af7d3dac None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.157157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 365/741] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:16.158783 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca507381-6c86-41fc-a462-8c42af7d3dac None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:16.207055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9083e98-eaef-463f-b849-07e7483d47ff None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:16.245913 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b52495-dd12-41d2-9bcc-45a258d46e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:16.246626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b52495-dd12-41d2-9bcc-45a258d46e8f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.246908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b52495-dd12-41d2-9bcc-45a258d46e8f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.247182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b52495-dd12-41d2-9bcc-45a258d46e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.295829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca507381-6c86-41fc-a462-8c42af7d3dac None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:16.327493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b52495-dd12-41d2-9bcc-45a258d46e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:16.328975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b52495-dd12-41d2-9bcc-45a258d46e8f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:16.336178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90f4a2-eeb3-4aba-adbb-55de8c93b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:16.337197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90f4a2-eeb3-4aba-adbb-55de8c93b4ad None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.337673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90f4a2-eeb3-4aba-adbb-55de8c93b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.338198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90f4a2-eeb3-4aba-adbb-55de8c93b4ad None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.339155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90f4a2-eeb3-4aba-adbb-55de8c93b4ad None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:16.339652 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90f4a2-eeb3-4aba-adbb-55de8c93b4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:16.341228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90f4a2-eeb3-4aba-adbb-55de8c93b4ad None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:16.352064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 366/742] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:16.353595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47111b1-14c6-4ae7-8398-f4bf45825e83 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.354090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47111b1-14c6-4ae7-8398-f4bf45825e83 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.354569 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47111b1-14c6-4ae7-8398-f4bf45825e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.372135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-d47111b1-14c6-4ae7-8398-f4bf45825e83 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:16.373689 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d47111b1-14c6-4ae7-8398-f4bf45825e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:16.436489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 377/743] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:16 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Feb 28 21:36:16.437387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b52495-dd12-41d2-9bcc-45a258d46e8f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:16.446311 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 367/744] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Feb 28 21:36:16.447388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47111b1-14c6-4ae7-8398-f4bf45825e83 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:16.546059 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47111b1-14c6-4ae7-8398-f4bf45825e83 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:16.561352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b52495-dd12-41d2-9bcc-45a258d46e8f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:16.580818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1601ce-27a3-442c-87e8-7f92a262653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:16.581753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1601ce-27a3-442c-87e8-7f92a262653e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.582170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1601ce-27a3-442c-87e8-7f92a262653e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.582547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1601ce-27a3-442c-87e8-7f92a262653e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.596231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009ea6d-3de5-4029-aec8-d8d8f4f45d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:16.596440 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1601ce-27a3-442c-87e8-7f92a262653e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:16.597482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009ea6d-3de5-4029-aec8-d8d8f4f45d19 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.597793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1601ce-27a3-442c-87e8-7f92a262653e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:16.598354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009ea6d-3de5-4029-aec8-d8d8f4f45d19 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.598802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009ea6d-3de5-4029-aec8-d8d8f4f45d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.610045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009ea6d-3de5-4029-aec8-d8d8f4f45d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:16.611748 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009ea6d-3de5-4029-aec8-d8d8f4f45d19 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:16.618976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-bf1601ce-27a3-442c-87e8-7f92a262653e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:16.620692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 368/745] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:16.621876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1601ce-27a3-442c-87e8-7f92a262653e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:16.631059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-6009ea6d-3de5-4029-aec8-d8d8f4f45d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:16.633073 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 378/746] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:16.634095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009ea6d-3de5-4029-aec8-d8d8f4f45d19 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:16.737908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1601ce-27a3-442c-87e8-7f92a262653e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:16.743064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009ea6d-3de5-4029-aec8-d8d8f4f45d19 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:16.776033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2156eb-d37f-4c28-a17d-713aa6d8df21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:16.776960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2156eb-d37f-4c28-a17d-713aa6d8df21 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.777236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2156eb-d37f-4c28-a17d-713aa6d8df21 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.777505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2156eb-d37f-4c28-a17d-713aa6d8df21 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.778249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2156eb-d37f-4c28-a17d-713aa6d8df21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:16.779169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a3089-0b7e-471b-b3d2-a1a82565c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:16.779606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2156eb-d37f-4c28-a17d-713aa6d8df21 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:16.779826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a3089-0b7e-471b-b3d2-a1a82565c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.780106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a3089-0b7e-471b-b3d2-a1a82565c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.780381 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a3089-0b7e-471b-b3d2-a1a82565c4e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.781094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a3089-0b7e-471b-b3d2-a1a82565c4e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:16.781403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a3089-0b7e-471b-b3d2-a1a82565c4e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:16.782948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a3089-0b7e-471b-b3d2-a1a82565c4e8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:16.794023 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 379/747] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:16.794835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a3089-0b7e-471b-b3d2-a1a82565c4e8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:16.876791 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 369/748] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:36:16 2022] POST /identity/v3/services => generated 240 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:16.878513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2ed6-74a7-4598-815a-411c26e6efd5 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.878801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2ed6-74a7-4598-815a-411c26e6efd5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.879074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2ed6-74a7-4598-815a-411c26e6efd5 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.881628 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 370/749] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:16.886998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df2ed6-74a7-4598-815a-411c26e6efd5 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:16.908608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a3089-0b7e-471b-b3d2-a1a82565c4e8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:16.955010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d5e8e-3604-4759-9d7a-361835e20ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:16.956061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d5e8e-3604-4759-9d7a-361835e20ff2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.956543 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d5e8e-3604-4759-9d7a-361835e20ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.957034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d5e8e-3604-4759-9d7a-361835e20ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.957960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d5e8e-3604-4759-9d7a-361835e20ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:16.958542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d5e8e-3604-4759-9d7a-361835e20ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:16.960237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d5e8e-3604-4759-9d7a-361835e20ff2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:16.974099 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 380/750] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:16.976019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ede01-0769-4d79-a192-916229239fb8 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:16.976545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ede01-0769-4d79-a192-916229239fb8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:16.977019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ede01-0769-4d79-a192-916229239fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:16.995953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-293ede01-0769-4d79-a192-916229239fb8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:16.997495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-293ede01-0769-4d79-a192-916229239fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:17.000233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df2ed6-74a7-4598-815a-411c26e6efd5 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:17.038092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce710-4f56-48d0-92ee-4214f72f2a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:17.038907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce710-4f56-48d0-92ee-4214f72f2a39 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:17.039360 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce710-4f56-48d0-92ee-4214f72f2a39 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:17.039500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce710-4f56-48d0-92ee-4214f72f2a39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:17.047043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ce710-4f56-48d0-92ee-4214f72f2a39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:17.048520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ce710-4f56-48d0-92ee-4214f72f2a39 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:17.062709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-7b7ce710-4f56-48d0-92ee-4214f72f2a39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:17.064126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 371/751] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:17.064878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce710-4f56-48d0-92ee-4214f72f2a39 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:17.079131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 381/752] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:17.080365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ede01-0769-4d79-a192-916229239fb8 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:17.191375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ede01-0769-4d79-a192-916229239fb8 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:17.202225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce710-4f56-48d0-92ee-4214f72f2a39 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:17.232841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379ef38-ca28-445b-89f5-b5bcdcddfd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:17.233680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ef38-ca28-445b-89f5-b5bcdcddfd3e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:17.234012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ef38-ca28-445b-89f5-b5bcdcddfd3e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:17.234618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379ef38-ca28-445b-89f5-b5bcdcddfd3e None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:17.235679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379ef38-ca28-445b-89f5-b5bcdcddfd3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:17.235982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379ef38-ca28-445b-89f5-b5bcdcddfd3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:17.238191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379ef38-ca28-445b-89f5-b5bcdcddfd3e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:17.242556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04913234-d0fb-4b07-8aff-ee8e8386cb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:17.243369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04913234-d0fb-4b07-8aff-ee8e8386cb75 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:17.243649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04913234-d0fb-4b07-8aff-ee8e8386cb75 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:17.243985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04913234-d0fb-4b07-8aff-ee8e8386cb75 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:17.251031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 382/753] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:17.251985 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379ef38-ca28-445b-89f5-b5bcdcddfd3e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:17.253026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04913234-d0fb-4b07-8aff-ee8e8386cb75 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:17.254521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04913234-d0fb-4b07-8aff-ee8e8386cb75 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:17.274288 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-04913234-d0fb-4b07-8aff-ee8e8386cb75 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 21:36:17.275826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 372/754] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:17.277092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04913234-d0fb-4b07-8aff-ee8e8386cb75 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:17.373559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379ef38-ca28-445b-89f5-b5bcdcddfd3e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:17.387749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04913234-d0fb-4b07-8aff-ee8e8386cb75 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:17.408414 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382b99-cbad-42d8-a7c2-3b46a33c427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:17.409217 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382b99-cbad-42d8-a7c2-3b46a33c427a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:17.409502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382b99-cbad-42d8-a7c2-3b46a33c427a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:17.409776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc382b99-cbad-42d8-a7c2-3b46a33c427a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:17.420722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc382b99-cbad-42d8-a7c2-3b46a33c427a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:17.420967 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a20cb-0da4-4b0e-90ce-155ad07b54f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:17.421611 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a20cb-0da4-4b0e-90ce-155ad07b54f4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:17.421888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a20cb-0da4-4b0e-90ce-155ad07b54f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:17.422201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a20cb-0da4-4b0e-90ce-155ad07b54f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:17.423088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a20cb-0da4-4b0e-90ce-155ad07b54f4 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=368937ee42184e31b346ab9db570c122) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:17.423395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a20cb-0da4-4b0e-90ce-155ad07b54f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:17.424800 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a20cb-0da4-4b0e-90ce-155ad07b54f4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:17.428350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-fc382b99-cbad-42d8-a7c2-3b46a33c427a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:36:17.430093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 383/755] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:17.430873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382b99-cbad-42d8-a7c2-3b46a33c427a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:17.435746 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 373/756] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/role_assignments?user.id=368937ee42184e31b346ab9db570c122&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:17.437089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a20cb-0da4-4b0e-90ce-155ad07b54f4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:17.538403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc382b99-cbad-42d8-a7c2-3b46a33c427a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:17.541329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a20cb-0da4-4b0e-90ce-155ad07b54f4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:17.575859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ae91d-ea79-4b2d-a40f-8adfbfddbc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:17.576844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ae91d-ea79-4b2d-a40f-8adfbfddbc85 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:17.577129 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ae91d-ea79-4b2d-a40f-8adfbfddbc85 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:17.577497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ae91d-ea79-4b2d-a40f-8adfbfddbc85 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:17.577879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc075fe7-cb34-4196-b2a9-a2c3f8a270a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:17.578370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ae91d-ea79-4b2d-a40f-8adfbfddbc85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:17.578593 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc075fe7-cb34-4196-b2a9-a2c3f8a270a1 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:17.578741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ae91d-ea79-4b2d-a40f-8adfbfddbc85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:17.578879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc075fe7-cb34-4196-b2a9-a2c3f8a270a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:17.579127 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc075fe7-cb34-4196-b2a9-a2c3f8a270a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:17.579883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc075fe7-cb34-4196-b2a9-a2c3f8a270a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:17.580108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ae91d-ea79-4b2d-a40f-8adfbfddbc85 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:17.580267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc075fe7-cb34-4196-b2a9-a2c3f8a270a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:17.581523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc075fe7-cb34-4196-b2a9-a2c3f8a270a1 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:17.595968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 374/757] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:17.597678 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc075fe7-cb34-4196-b2a9-a2c3f8a270a1 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:17.601407 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 384/758] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:17.611237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ae91d-ea79-4b2d-a40f-8adfbfddbc85 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:17.707732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc075fe7-cb34-4196-b2a9-a2c3f8a270a1 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:17.720947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ae91d-ea79-4b2d-a40f-8adfbfddbc85 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:17.745875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595e2f1-7ea5-4cf5-8a53-6c09eb0d20e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:17.746738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595e2f1-7ea5-4cf5-8a53-6c09eb0d20e7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:17.747012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595e2f1-7ea5-4cf5-8a53-6c09eb0d20e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:17.747274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595e2f1-7ea5-4cf5-8a53-6c09eb0d20e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:17.756890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5bb32-c982-4955-ba72-6b5456bc18f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:17.757548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5bb32-c982-4955-ba72-6b5456bc18f2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:17.758121 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5bb32-c982-4955-ba72-6b5456bc18f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:17.758398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5bb32-c982-4955-ba72-6b5456bc18f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:17.758567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595e2f1-7ea5-4cf5-8a53-6c09eb0d20e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:17.759899 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595e2f1-7ea5-4cf5-8a53-6c09eb0d20e7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:17.777674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-3595e2f1-7ea5-4cf5-8a53-6c09eb0d20e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:17.783886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 375/759] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:17.785115 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595e2f1-7ea5-4cf5-8a53-6c09eb0d20e7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:17.832500 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5bb32-c982-4955-ba72-6b5456bc18f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:17.839760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5bb32-c982-4955-ba72-6b5456bc18f2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:17.894838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595e2f1-7ea5-4cf5-8a53-6c09eb0d20e7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:17.931608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd2418-27df-47e3-9d57-53ed138321d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:17.932280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2418-27df-47e3-9d57-53ed138321d7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:17.932557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2418-27df-47e3-9d57-53ed138321d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:17.932829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2418-27df-47e3-9d57-53ed138321d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:17.933884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd2418-27df-47e3-9d57-53ed138321d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:17.934492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd2418-27df-47e3-9d57-53ed138321d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:17.936224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd2418-27df-47e3-9d57-53ed138321d7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:17.957327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 376/760] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:17.959634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd2418-27df-47e3-9d57-53ed138321d7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:17.988907 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 385/761] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:36:17.994433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5bb32-c982-4955-ba72-6b5456bc18f2 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:18.064607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd2418-27df-47e3-9d57-53ed138321d7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:18.100774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af672db-599d-4e46-ae2b-16f8d362fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:18.101936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af672db-599d-4e46-ae2b-16f8d362fb59 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:18.102455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af672db-599d-4e46-ae2b-16f8d362fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:18.102926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af672db-599d-4e46-ae2b-16f8d362fb59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:18.111537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af672db-599d-4e46-ae2b-16f8d362fb59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:18.113364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af672db-599d-4e46-ae2b-16f8d362fb59 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:18.128714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-9af672db-599d-4e46-ae2b-16f8d362fb59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 21:36:18.130715 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 377/762] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:18.142988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af672db-599d-4e46-ae2b-16f8d362fb59 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:18.181706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5bb32-c982-4955-ba72-6b5456bc18f2 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:18.231634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6706a7-24b0-41f0-ab7f-ffb5f4116785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:18.232446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6706a7-24b0-41f0-ab7f-ffb5f4116785 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:18.232726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6706a7-24b0-41f0-ab7f-ffb5f4116785 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:18.233001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6706a7-24b0-41f0-ab7f-ffb5f4116785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:18.244483 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af672db-599d-4e46-ae2b-16f8d362fb59 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:18.256867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6706a7-24b0-41f0-ab7f-ffb5f4116785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:18.258654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6706a7-24b0-41f0-ab7f-ffb5f4116785 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:18.280464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05aca5-0eeb-4dbc-aada-93600f27fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:18.281576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05aca5-0eeb-4dbc-aada-93600f27fa83 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:18.282139 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05aca5-0eeb-4dbc-aada-93600f27fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:18.282620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05aca5-0eeb-4dbc-aada-93600f27fa83 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:18.283775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05aca5-0eeb-4dbc-aada-93600f27fa83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:18.284347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05aca5-0eeb-4dbc-aada-93600f27fa83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:18.285983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05aca5-0eeb-4dbc-aada-93600f27fa83 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:18.290987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-5c6706a7-24b0-41f0-ab7f-ffb5f4116785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:18.294095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 386/763] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:18.296413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6706a7-24b0-41f0-ab7f-ffb5f4116785 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:18.309864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 378/764] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Feb 28 21:36:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:18.314942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05aca5-0eeb-4dbc-aada-93600f27fa83 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:18.481290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05aca5-0eeb-4dbc-aada-93600f27fa83 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:18.503100 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6706a7-24b0-41f0-ab7f-ffb5f4116785 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:18.529923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5856e32-3cb1-4241-86cc-55c82447e801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:18.531159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5856e32-3cb1-4241-86cc-55c82447e801 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:18.531686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5856e32-3cb1-4241-86cc-55c82447e801 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:18.532175 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5856e32-3cb1-4241-86cc-55c82447e801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:18.546911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daa5ba-9135-4df8-a688-daffcd0e92b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:18.547582 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daa5ba-9135-4df8-a688-daffcd0e92b4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:18.547879 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daa5ba-9135-4df8-a688-daffcd0e92b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:18.548138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daa5ba-9135-4df8-a688-daffcd0e92b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:18.548860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daa5ba-9135-4df8-a688-daffcd0e92b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:18.549166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daa5ba-9135-4df8-a688-daffcd0e92b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:18.550601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daa5ba-9135-4df8-a688-daffcd0e92b4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:18.560272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5856e32-3cb1-4241-86cc-55c82447e801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:18.561726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5856e32-3cb1-4241-86cc-55c82447e801 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:18.574536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 387/765] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:18.579365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daa5ba-9135-4df8-a688-daffcd0e92b4 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:18.596088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-e5856e32-3cb1-4241-86cc-55c82447e801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:18.597495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 379/766] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:18.603645 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5856e32-3cb1-4241-86cc-55c82447e801 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:18.723127 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daa5ba-9135-4df8-a688-daffcd0e92b4 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:18.769218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef5bb-6cca-4e75-aefb-38596f02e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:18.770383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef5bb-6cca-4e75-aefb-38596f02e392 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:18.770908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef5bb-6cca-4e75-aefb-38596f02e392 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:18.772081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef5bb-6cca-4e75-aefb-38596f02e392 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:18.781354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ef5bb-6cca-4e75-aefb-38596f02e392 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:18.783865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ef5bb-6cca-4e75-aefb-38596f02e392 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:18.794366 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5856e32-3cb1-4241-86cc-55c82447e801 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:18.804948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-898ef5bb-6cca-4e75-aefb-38596f02e392 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:18.807408 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 388/767] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:18.809429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94e40-d473-4e8d-b717-707c5dfb5190 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:18.810212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94e40-d473-4e8d-b717-707c5dfb5190 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:18.810707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a94e40-d473-4e8d-b717-707c5dfb5190 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:18.813571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 389/768] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:18.814523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94e40-d473-4e8d-b717-707c5dfb5190 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:18.832334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4dd9d-eb16-4ddc-b694-679fd1893dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:18.832995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4dd9d-eb16-4ddc-b694-679fd1893dc2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:18.835266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4dd9d-eb16-4ddc-b694-679fd1893dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:18.835266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4dd9d-eb16-4ddc-b694-679fd1893dc2 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:18.835266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4dd9d-eb16-4ddc-b694-679fd1893dc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:18.835266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4dd9d-eb16-4ddc-b694-679fd1893dc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:18.836871 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4dd9d-eb16-4ddc-b694-679fd1893dc2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:18.859409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 380/769] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:18.861013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f3d9-afaf-4262-8a2e-8741e09a0f03 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:18.861299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f3d9-afaf-4262-8a2e-8741e09a0f03 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:18.861574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f3d9-afaf-4262-8a2e-8741e09a0f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:18.881396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ad05f3d9-afaf-4262-8a2e-8741e09a0f03 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:18.882878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ad05f3d9-afaf-4262-8a2e-8741e09a0f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:18.951000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a94e40-d473-4e8d-b717-707c5dfb5190 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:18.969372 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 381/770] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:18.970599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f3d9-afaf-4262-8a2e-8741e09a0f03 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:19.002960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e5763-148f-473b-ab1a-47a7b2679116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:19.003635 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e5763-148f-473b-ab1a-47a7b2679116 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.003937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e5763-148f-473b-ab1a-47a7b2679116 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.004536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e5763-148f-473b-ab1a-47a7b2679116 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.004982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e5763-148f-473b-ab1a-47a7b2679116 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:19.005291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e5763-148f-473b-ab1a-47a7b2679116 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:19.007540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e5763-148f-473b-ab1a-47a7b2679116 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:19.026378 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 390/771] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:19.027335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e5763-148f-473b-ab1a-47a7b2679116 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:19.094108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05f3d9-afaf-4262-8a2e-8741e09a0f03 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:19.130137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bed10-0496-4789-a3a2-152d8ece5f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:19.131941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e5763-148f-473b-ab1a-47a7b2679116 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:19.132291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bed10-0496-4789-a3a2-152d8ece5f86 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.133212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bed10-0496-4789-a3a2-152d8ece5f86 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.133934 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bed10-0496-4789-a3a2-152d8ece5f86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.141134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bed10-0496-4789-a3a2-152d8ece5f86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:19.142855 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bed10-0496-4789-a3a2-152d8ece5f86 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:19.156697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-033bed10-0496-4789-a3a2-152d8ece5f86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:19.158161 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 382/772] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:19.159123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bed10-0496-4789-a3a2-152d8ece5f86 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:19.172992 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5abc8-60f7-4707-9d45-8c991306d0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:19.173812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5abc8-60f7-4707-9d45-8c991306d0fe None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.174121 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5abc8-60f7-4707-9d45-8c991306d0fe None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.174394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5abc8-60f7-4707-9d45-8c991306d0fe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.175050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5abc8-60f7-4707-9d45-8c991306d0fe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:19.176414 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5abc8-60f7-4707-9d45-8c991306d0fe None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:19.188642 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-02d5abc8-60f7-4707-9d45-8c991306d0fe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 28 21:36:19.195816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 391/773] 10.222.0.26 () {56 vars in 1129 bytes} [Mon Feb 28 21:36:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:19.196864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5abc8-60f7-4707-9d45-8c991306d0fe None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:19.267517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bed10-0496-4789-a3a2-152d8ece5f86 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:19.301445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2b9b-2c10-4592-9d95-0b9eb570efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:19.302599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2b9b-2c10-4592-9d95-0b9eb570efb3 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.303092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2b9b-2c10-4592-9d95-0b9eb570efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.303195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5abc8-60f7-4707-9d45-8c991306d0fe None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:19.303683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2b9b-2c10-4592-9d95-0b9eb570efb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.304703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2b9b-2c10-4592-9d95-0b9eb570efb3 None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=3e0f83cdc2d54ced991c979f9de554a0) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:19.305227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2b9b-2c10-4592-9d95-0b9eb570efb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:19.306876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2b9b-2c10-4592-9d95-0b9eb570efb3 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:19.313050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 383/774] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:19 2022] GET /identity/v3/role_assignments?user.id=3e0f83cdc2d54ced991c979f9de554a0&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:19.314140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2b9b-2c10-4592-9d95-0b9eb570efb3 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:19.367522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb44c6-9cbe-49f5-af2c-cb5bf33a2921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:19.368209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb44c6-9cbe-49f5-af2c-cb5bf33a2921 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.368497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb44c6-9cbe-49f5-af2c-cb5bf33a2921 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.368775 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb44c6-9cbe-49f5-af2c-cb5bf33a2921 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.369697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb44c6-9cbe-49f5-af2c-cb5bf33a2921 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:19.369898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb44c6-9cbe-49f5-af2c-cb5bf33a2921 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:19.371425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb44c6-9cbe-49f5-af2c-cb5bf33a2921 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:19.402416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 392/775] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:19.403389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb44c6-9cbe-49f5-af2c-cb5bf33a2921 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:19.423081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2b9b-2c10-4592-9d95-0b9eb570efb3 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:19.465395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9e5ae-7c66-426e-ba65-84b5eb6e04b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:19.466529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9e5ae-7c66-426e-ba65-84b5eb6e04b0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.467009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9e5ae-7c66-426e-ba65-84b5eb6e04b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.467475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9e5ae-7c66-426e-ba65-84b5eb6e04b0 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.468438 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9e5ae-7c66-426e-ba65-84b5eb6e04b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:19.468955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9e5ae-7c66-426e-ba65-84b5eb6e04b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:19.470616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9e5ae-7c66-426e-ba65-84b5eb6e04b0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:19.477154 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 384/776] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Feb 28 21:36:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:19.482295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9e5ae-7c66-426e-ba65-84b5eb6e04b0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:19.593882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9e5ae-7c66-426e-ba65-84b5eb6e04b0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:19.624777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb44c6-9cbe-49f5-af2c-cb5bf33a2921 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:19.650461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade8887-7437-4593-8c67-4659bacdc917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:19.651132 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade8887-7437-4593-8c67-4659bacdc917 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.651404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade8887-7437-4593-8c67-4659bacdc917 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.651669 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade8887-7437-4593-8c67-4659bacdc917 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.652822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade8887-7437-4593-8c67-4659bacdc917 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:19.653128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade8887-7437-4593-8c67-4659bacdc917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:19.654825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade8887-7437-4593-8c67-4659bacdc917 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:19.662278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 385/777] 10.222.0.26 () {56 vars in 1124 bytes} [Mon Feb 28 21:36:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:19.663941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09ea02-8be1-4cdf-bceb-f21e426c79d1 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.664228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09ea02-8be1-4cdf-bceb-f21e426c79d1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.664503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09ea02-8be1-4cdf-bceb-f21e426c79d1 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.670294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 386/778] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:19.670294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09ea02-8be1-4cdf-bceb-f21e426c79d1 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:19.672220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd450c-4ccb-482b-a912-e487d0190ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:19.673368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd450c-4ccb-482b-a912-e487d0190ae8 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.673859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd450c-4ccb-482b-a912-e487d0190ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.674364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd450c-4ccb-482b-a912-e487d0190ae8 None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/8182c282a5754f05b4bb6bb7057fa7ab/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.676763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd450c-4ccb-482b-a912-e487d0190ae8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=8182c282a5754f05b4bb6bb7057fa7ab, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:19.679067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd450c-4ccb-482b-a912-e487d0190ae8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:19.754333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 393/779] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:36:19 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/8182c282a5754f05b4bb6bb7057fa7ab/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:36:19.756586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95e0b-82bc-4821-b428-c612dd348337 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.757092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95e0b-82bc-4821-b428-c612dd348337 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.757833 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95e0b-82bc-4821-b428-c612dd348337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.772574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09ea02-8be1-4cdf-bceb-f21e426c79d1 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:19.792338 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-80d95e0b-82bc-4821-b428-c612dd348337 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:19.793974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-80d95e0b-82bc-4821-b428-c612dd348337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:19.809886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121818e-527a-4a36-ac8a-dc0a32c80238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:19.810583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121818e-527a-4a36-ac8a-dc0a32c80238 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:19.811117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121818e-527a-4a36-ac8a-dc0a32c80238 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:19.811117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121818e-527a-4a36-ac8a-dc0a32c80238 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:19.811841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121818e-527a-4a36-ac8a-dc0a32c80238 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:19.813201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121818e-527a-4a36-ac8a-dc0a32c80238 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:19.907794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 394/780] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:19.932132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95e0b-82bc-4821-b428-c612dd348337 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:19.951325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 387/781] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Feb 28 21:36:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:36:20.050726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95e0b-82bc-4821-b428-c612dd348337 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:20.093401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b24849-f380-4835-9b8a-07200b284ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:20.094228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b24849-f380-4835-9b8a-07200b284ec0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:20.094505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b24849-f380-4835-9b8a-07200b284ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:20.094770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b24849-f380-4835-9b8a-07200b284ec0 None admin] PATH_INFO: `/v3/services/network` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:20.095416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b24849-f380-4835-9b8a-07200b284ec0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:20.096793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b24849-f380-4835-9b8a-07200b284ec0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:20.109436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-25b24849-f380-4835-9b8a-07200b284ec0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 21:36:20.116006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 395/782] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:19 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:20.117378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121818e-527a-4a36-ac8a-dc0a32c80238 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:20.227616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121818e-527a-4a36-ac8a-dc0a32c80238 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:20.260890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125da5f-d4a8-471c-8da4-7088cd29385d None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:20.261186 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125da5f-d4a8-471c-8da4-7088cd29385d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:20.261457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125da5f-d4a8-471c-8da4-7088cd29385d None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:20.262281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917a194-118c-45ff-8dbb-f210dd7c6c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:20.263154 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917a194-118c-45ff-8dbb-f210dd7c6c81 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:20.263514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 396/783] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:20.263867 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917a194-118c-45ff-8dbb-f210dd7c6c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:20.264313 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917a194-118c-45ff-8dbb-f210dd7c6c81 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:20.265300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917a194-118c-45ff-8dbb-f210dd7c6c81 None admin] RBAC: Adding query filter params (name=network) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:20.265770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917a194-118c-45ff-8dbb-f210dd7c6c81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:20.267459 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917a194-118c-45ff-8dbb-f210dd7c6c81 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:20.268519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae068484-b2b7-46e9-8ec6-a6afd6e558d1 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:20.268811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae068484-b2b7-46e9-8ec6-a6afd6e558d1 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:20.269084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae068484-b2b7-46e9-8ec6-a6afd6e558d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:20.280067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 388/784] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:20.283072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917a194-118c-45ff-8dbb-f210dd7c6c81 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:20.293669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ae068484-b2b7-46e9-8ec6-a6afd6e558d1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:20.295181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ae068484-b2b7-46e9-8ec6-a6afd6e558d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:20.367626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 397/785] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:20.384581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917a194-118c-45ff-8dbb-f210dd7c6c81 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:20.391818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae068484-b2b7-46e9-8ec6-a6afd6e558d1 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:20.419468 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dfd81-edb3-4d8d-bb94-8efb4e67827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:20.420008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dfd81-edb3-4d8d-bb94-8efb4e67827c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:20.420296 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dfd81-edb3-4d8d-bb94-8efb4e67827c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:20.420567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dfd81-edb3-4d8d-bb94-8efb4e67827c None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:20.421268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dfd81-edb3-4d8d-bb94-8efb4e67827c None admin] RBAC: Adding query filter params (type=network) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:20.421567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dfd81-edb3-4d8d-bb94-8efb4e67827c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:20.422947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dfd81-edb3-4d8d-bb94-8efb4e67827c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:20.432847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 389/786] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:20.435391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dfd81-edb3-4d8d-bb94-8efb4e67827c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:20.508169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae068484-b2b7-46e9-8ec6-a6afd6e558d1 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:20.541477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dfd81-edb3-4d8d-bb94-8efb4e67827c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:20.547337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13a13e-9a9e-49b0-8581-3c4d0964253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:20.548449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13a13e-9a9e-49b0-8581-3c4d0964253b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:20.548908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13a13e-9a9e-49b0-8581-3c4d0964253b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:20.549364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13a13e-9a9e-49b0-8581-3c4d0964253b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:20.560494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13a13e-9a9e-49b0-8581-3c4d0964253b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:20.567830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-2c13a13e-9a9e-49b0-8581-3c4d0964253b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:36:20.569786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 398/787] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:20.575618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13a13e-9a9e-49b0-8581-3c4d0964253b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:20.592180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27b15d-4826-4264-8582-6c18a6866db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:20.592849 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b15d-4826-4264-8582-6c18a6866db0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:20.593124 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b15d-4826-4264-8582-6c18a6866db0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:20.593392 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b15d-4826-4264-8582-6c18a6866db0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:20.594213 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27b15d-4826-4264-8582-6c18a6866db0 None admin] RBAC: Adding query filter params (interface=public, service_id=d0e00e39e46d42fc998034da4bc9580b, region_id=RegionOne) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:20.594518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27b15d-4826-4264-8582-6c18a6866db0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:20.595885 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27b15d-4826-4264-8582-6c18a6866db0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:20.613813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 390/788] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Feb 28 21:36:20 2022] GET /identity/v3/endpoints?service_id=d0e00e39e46d42fc998034da4bc9580b&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:20.619329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27b15d-4826-4264-8582-6c18a6866db0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:20.682419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13a13e-9a9e-49b0-8581-3c4d0964253b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:20.718809 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46701a9-1ddd-4e54-a529-8dee11dc6184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:20.719793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46701a9-1ddd-4e54-a529-8dee11dc6184 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:20.720274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46701a9-1ddd-4e54-a529-8dee11dc6184 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:20.720779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46701a9-1ddd-4e54-a529-8dee11dc6184 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:20.721723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46701a9-1ddd-4e54-a529-8dee11dc6184 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:20.722245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46701a9-1ddd-4e54-a529-8dee11dc6184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:20.723888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46701a9-1ddd-4e54-a529-8dee11dc6184 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:20.733893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 399/789] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:20.739511 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46701a9-1ddd-4e54-a529-8dee11dc6184 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:20.844726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46701a9-1ddd-4e54-a529-8dee11dc6184 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:20.883606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27b15d-4826-4264-8582-6c18a6866db0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:20.900128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2effa-a827-4f35-84ce-372f4a96cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:20.902848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2effa-a827-4f35-84ce-372f4a96cefd None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:20.902848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2effa-a827-4f35-84ce-372f4a96cefd None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:20.902848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2effa-a827-4f35-84ce-372f4a96cefd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:20.921116 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2effa-a827-4f35-84ce-372f4a96cefd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:20.924708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2effa-a827-4f35-84ce-372f4a96cefd None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:20.926738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c2402-ac03-4e4a-b9c3-60256ee9f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:20.928182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c2402-ac03-4e4a-b9c3-60256ee9f685 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:20.928654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c2402-ac03-4e4a-b9c3-60256ee9f685 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:20.929113 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c2402-ac03-4e4a-b9c3-60256ee9f685 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:20.930088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c2402-ac03-4e4a-b9c3-60256ee9f685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:20.931826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c2402-ac03-4e4a-b9c3-60256ee9f685 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:20.943585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 391/790] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Feb 28 21:36:20 2022] GET /identity/v3/services => generated 772 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:20.954335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-35d2effa-a827-4f35-84ce-372f4a96cefd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:20.956286 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 400/791] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:20.961861 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c2402-ac03-4e4a-b9c3-60256ee9f685 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:21.067285 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c2402-ac03-4e4a-b9c3-60256ee9f685 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:21.110918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009ee09-4ae0-490f-a5dc-f2277df9db1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:21.112049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009ee09-4ae0-490f-a5dc-f2277df9db1f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:21.112549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009ee09-4ae0-490f-a5dc-f2277df9db1f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:21.113031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009ee09-4ae0-490f-a5dc-f2277df9db1f None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:21.113971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009ee09-4ae0-490f-a5dc-f2277df9db1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:21.114508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009ee09-4ae0-490f-a5dc-f2277df9db1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:21.116910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009ee09-4ae0-490f-a5dc-f2277df9db1f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:21.136417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 392/792] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:21.141589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2effa-a827-4f35-84ce-372f4a96cefd None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:21.284999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2effa-a827-4f35-84ce-372f4a96cefd None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:21.323220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84376ad6-eaaf-4977-9457-d6e0251924a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:21.324023 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84376ad6-eaaf-4977-9457-d6e0251924a8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:21.324304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84376ad6-eaaf-4977-9457-d6e0251924a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:21.324574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84376ad6-eaaf-4977-9457-d6e0251924a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:21.332405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84376ad6-eaaf-4977-9457-d6e0251924a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:21.334590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84376ad6-eaaf-4977-9457-d6e0251924a8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:21.349813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-84376ad6-eaaf-4977-9457-d6e0251924a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 21:36:21.351362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 401/793] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:21.357008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009ee09-4ae0-490f-a5dc-f2277df9db1f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:21.468109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009ee09-4ae0-490f-a5dc-f2277df9db1f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:21.510191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8859635-b40c-46f3-bea7-ec1e6593d4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:21.511236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8859635-b40c-46f3-bea7-ec1e6593d4b4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:21.511717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8859635-b40c-46f3-bea7-ec1e6593d4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:21.512204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8859635-b40c-46f3-bea7-ec1e6593d4b4 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:21.513239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8859635-b40c-46f3-bea7-ec1e6593d4b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:21.513765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8859635-b40c-46f3-bea7-ec1e6593d4b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:21.515423 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8859635-b40c-46f3-bea7-ec1e6593d4b4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:21.535191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 393/794] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Feb 28 21:36:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:21.540940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84376ad6-eaaf-4977-9457-d6e0251924a8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:21.708619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84376ad6-eaaf-4977-9457-d6e0251924a8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:21.756514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb28f1-df1b-4b10-936b-73293c2f4bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:21.757009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb28f1-df1b-4b10-936b-73293c2f4bec None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:21.757289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb28f1-df1b-4b10-936b-73293c2f4bec None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:21.757803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb28f1-df1b-4b10-936b-73293c2f4bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:21.770132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb28f1-df1b-4b10-936b-73293c2f4bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:21.771974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb28f1-df1b-4b10-936b-73293c2f4bec None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:21.793915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a7cb28f1-df1b-4b10-936b-73293c2f4bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:21.795459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 402/795] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:21.800979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8859635-b40c-46f3-bea7-ec1e6593d4b4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:21.920046 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8859635-b40c-46f3-bea7-ec1e6593d4b4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:21.956290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175597d-8133-487f-bff7-f6d1b34f5826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:21.956956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175597d-8133-487f-bff7-f6d1b34f5826 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:21.957233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175597d-8133-487f-bff7-f6d1b34f5826 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:21.957504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175597d-8133-487f-bff7-f6d1b34f5826 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:21.958249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175597d-8133-487f-bff7-f6d1b34f5826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:21.959133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175597d-8133-487f-bff7-f6d1b34f5826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:21.960498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175597d-8133-487f-bff7-f6d1b34f5826 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:21.972292 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 394/796] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:21.977948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb28f1-df1b-4b10-936b-73293c2f4bec None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:22.033744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc797b-6075-4cce-9d8e-4e3c882312d1 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:22.034059 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc797b-6075-4cce-9d8e-4e3c882312d1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:22.034279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc797b-6075-4cce-9d8e-4e3c882312d1 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:22.036304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 395/797] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:22.041291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e57e01-7478-4f55-88f6-8ab514600257 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:22.041576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e57e01-7478-4f55-88f6-8ab514600257 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:22.041850 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e57e01-7478-4f55-88f6-8ab514600257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:22.067207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a0e57e01-7478-4f55-88f6-8ab514600257 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:22.069136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a0e57e01-7478-4f55-88f6-8ab514600257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:22.136962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb28f1-df1b-4b10-936b-73293c2f4bec None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:22.177826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b0b26-615b-4aa1-ab1e-f3ccce5d0f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:22.179470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b0b26-615b-4aa1-ab1e-f3ccce5d0f1f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:22.179978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b0b26-615b-4aa1-ab1e-f3ccce5d0f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:22.180481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b0b26-615b-4aa1-ab1e-f3ccce5d0f1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:22.193511 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b0b26-615b-4aa1-ab1e-f3ccce5d0f1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:22.196092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b0b26-615b-4aa1-ab1e-f3ccce5d0f1f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:22.215564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-f55b0b26-615b-4aa1-ab1e-f3ccce5d0f1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:22.220516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 396/798] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:22.222481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 403/799] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:22.230028 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e57e01-7478-4f55-88f6-8ab514600257 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:22.270275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b0b26-615b-4aa1-ab1e-f3ccce5d0f1f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:22.405478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e57e01-7478-4f55-88f6-8ab514600257 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:22.449033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c8d9-5ea3-475d-b2d7-c60b906a6bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:22.449694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c8d9-5ea3-475d-b2d7-c60b906a6bd6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:22.449971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c8d9-5ea3-475d-b2d7-c60b906a6bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:22.450266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149c8d9-5ea3-475d-b2d7-c60b906a6bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:22.451262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c8d9-5ea3-475d-b2d7-c60b906a6bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:22.451564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c8d9-5ea3-475d-b2d7-c60b906a6bd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:22.454869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149c8d9-5ea3-475d-b2d7-c60b906a6bd6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:22.459345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b0b26-615b-4aa1-ab1e-f3ccce5d0f1f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:22.476127 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 397/800] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:22.481972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c8d9-5ea3-475d-b2d7-c60b906a6bd6 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:22.533913 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd1104-228a-4e33-a91b-b6c06db97fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:22.534745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd1104-228a-4e33-a91b-b6c06db97fa0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:22.535024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd1104-228a-4e33-a91b-b6c06db97fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:22.535294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd1104-228a-4e33-a91b-b6c06db97fa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:22.556506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd1104-228a-4e33-a91b-b6c06db97fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:22.564376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-edcd1104-228a-4e33-a91b-b6c06db97fa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:36:22.566267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 404/801] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:22.571883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd1104-228a-4e33-a91b-b6c06db97fa0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:22.689608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149c8d9-5ea3-475d-b2d7-c60b906a6bd6 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:22.730504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23edf11-d45c-4f13-a956-bf90019eeb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:22.731446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23edf11-d45c-4f13-a956-bf90019eeb22 None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:22.731729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23edf11-d45c-4f13-a956-bf90019eeb22 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:22.732437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23edf11-d45c-4f13-a956-bf90019eeb22 None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/368937ee42184e31b346ab9db570c122/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:22.734804 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23edf11-d45c-4f13-a956-bf90019eeb22 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=368937ee42184e31b346ab9db570c122, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:22.736864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23edf11-d45c-4f13-a956-bf90019eeb22 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:22.745327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd1104-228a-4e33-a91b-b6c06db97fa0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:22.779032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf0e91-436e-47e9-9c82-82634d12850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:22.779699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf0e91-436e-47e9-9c82-82634d12850e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:22.779980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf0e91-436e-47e9-9c82-82634d12850e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:22.780249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf0e91-436e-47e9-9c82-82634d12850e None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:22.780988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf0e91-436e-47e9-9c82-82634d12850e None admin] RBAC: Adding query filter params (name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:22.781293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf0e91-436e-47e9-9c82-82634d12850e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:22.782672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf0e91-436e-47e9-9c82-82634d12850e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:22.791486 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 405/802] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:36:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:22.792747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38309-3e9e-4ed7-8259-a3dd6b66aefb None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:22.793066 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38309-3e9e-4ed7-8259-a3dd6b66aefb None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:22.793311 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a38309-3e9e-4ed7-8259-a3dd6b66aefb None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:22.795214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 406/803] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:22.796894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a38309-3e9e-4ed7-8259-a3dd6b66aefb None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:22.834097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 398/804] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:36:22 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/368937ee42184e31b346ab9db570c122/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:36:22.835907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af697-778c-4296-95aa-d2fdeb5ea6c3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:22.836294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af697-778c-4296-95aa-d2fdeb5ea6c3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:22.836670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af697-778c-4296-95aa-d2fdeb5ea6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:22.877192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-3c8af697-778c-4296-95aa-d2fdeb5ea6c3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:22.878487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3c8af697-778c-4296-95aa-d2fdeb5ea6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:22.922861 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a38309-3e9e-4ed7-8259-a3dd6b66aefb None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:22.965112 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ce46-9a29-41ae-8561-d6b571109d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:22.965846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ce46-9a29-41ae-8561-d6b571109d76 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:22.966160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ce46-9a29-41ae-8561-d6b571109d76 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:22.966433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ce46-9a29-41ae-8561-d6b571109d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:22.979367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117ce46-9a29-41ae-8561-d6b571109d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:22.980834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117ce46-9a29-41ae-8561-d6b571109d76 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:23.000317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-3117ce46-9a29-41ae-8561-d6b571109d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:23.001910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 407/805] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:23.007952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ce46-9a29-41ae-8561-d6b571109d76 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:23.012042 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 399/806] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:23.056953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af697-778c-4296-95aa-d2fdeb5ea6c3 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:23.142404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ce46-9a29-41ae-8561-d6b571109d76 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:23.219499 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af697-778c-4296-95aa-d2fdeb5ea6c3 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:23.227267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c2849-e1a0-4db1-8df4-056b19870ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:23.228223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2849-e1a0-4db1-8df4-056b19870ab6 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.228719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2849-e1a0-4db1-8df4-056b19870ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.229192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2849-e1a0-4db1-8df4-056b19870ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.230194 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c2849-e1a0-4db1-8df4-056b19870ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:23.230692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c2849-e1a0-4db1-8df4-056b19870ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:23.232260 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c2849-e1a0-4db1-8df4-056b19870ab6 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:23.255118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 408/807] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:23.261715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c2849-e1a0-4db1-8df4-056b19870ab6 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:23.265765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e95848-cc1e-4087-b4dc-0812d313e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:23.267160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e95848-cc1e-4087-b4dc-0812d313e702 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.267675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e95848-cc1e-4087-b4dc-0812d313e702 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.268172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e95848-cc1e-4087-b4dc-0812d313e702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.291033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e95848-cc1e-4087-b4dc-0812d313e702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:23.298385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-a9e95848-cc1e-4087-b4dc-0812d313e702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:36:23.304993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 400/808] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:23.310843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e95848-cc1e-4087-b4dc-0812d313e702 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:23.414479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c2849-e1a0-4db1-8df4-056b19870ab6 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:23.428019 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e95848-cc1e-4087-b4dc-0812d313e702 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:23.460355 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc05d-89d1-463c-9668-55f78fad78cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:23.461584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc05d-89d1-463c-9668-55f78fad78cd None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.462128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc05d-89d1-463c-9668-55f78fad78cd None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.462600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc05d-89d1-463c-9668-55f78fad78cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.463080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90601d39-c3da-40c6-ae84-0feb60076c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:23.463777 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90601d39-c3da-40c6-ae84-0feb60076c6a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.464040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90601d39-c3da-40c6-ae84-0feb60076c6a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.464313 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90601d39-c3da-40c6-ae84-0feb60076c6a None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.465073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90601d39-c3da-40c6-ae84-0feb60076c6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:23.465376 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90601d39-c3da-40c6-ae84-0feb60076c6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:23.466828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90601d39-c3da-40c6-ae84-0feb60076c6a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:23.473663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc05d-89d1-463c-9668-55f78fad78cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:23.475699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc05d-89d1-463c-9668-55f78fad78cd None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:23.476649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 401/809] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:23.478100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfb5ba-c24c-45e6-b257-daab61ecbec7 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.478550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfb5ba-c24c-45e6-b257-daab61ecbec7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.478927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfb5ba-c24c-45e6-b257-daab61ecbec7 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.484931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 402/810] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:23.485796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfb5ba-c24c-45e6-b257-daab61ecbec7 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:23.493661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-136cc05d-89d1-463c-9668-55f78fad78cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 21:36:23.495195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 409/811] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Feb 28 21:36:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:23.496404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa6ae-5bab-47d0-b0ce-0b9222e50961 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.496685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa6ae-5bab-47d0-b0ce-0b9222e50961 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.496955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa6ae-5bab-47d0-b0ce-0b9222e50961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.514149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e39aa6ae-5bab-47d0-b0ce-0b9222e50961 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:23.515341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e39aa6ae-5bab-47d0-b0ce-0b9222e50961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:23.590329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 410/812] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:23.591242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa6ae-5bab-47d0-b0ce-0b9222e50961 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:23.626039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfb5ba-c24c-45e6-b257-daab61ecbec7 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:23.669758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf9126-f902-4751-b976-c7c45da2e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:23.671061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf9126-f902-4751-b976-c7c45da2e587 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.671518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf9126-f902-4751-b976-c7c45da2e587 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.671948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf9126-f902-4751-b976-c7c45da2e587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.689095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf9126-f902-4751-b976-c7c45da2e587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:23.691346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf9126-f902-4751-b976-c7c45da2e587 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:23.710404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa6ae-5bab-47d0-b0ce-0b9222e50961 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:23.713744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-bbdf9126-f902-4751-b976-c7c45da2e587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:23.720050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 403/813] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:23.720050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf9126-f902-4751-b976-c7c45da2e587 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:23.759875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7463af8-cf20-4103-8d96-7e867b03882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:23.761213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7463af8-cf20-4103-8d96-7e867b03882e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.761709 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7463af8-cf20-4103-8d96-7e867b03882e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.762205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7463af8-cf20-4103-8d96-7e867b03882e None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.763344 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7463af8-cf20-4103-8d96-7e867b03882e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:23.763845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7463af8-cf20-4103-8d96-7e867b03882e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:23.765483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7463af8-cf20-4103-8d96-7e867b03882e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:23.788557 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 411/814] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Feb 28 21:36:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:23.789774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7463af8-cf20-4103-8d96-7e867b03882e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:23.846417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf9126-f902-4751-b976-c7c45da2e587 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:23.887199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd329c-8782-49c7-ba48-8443162dbb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:23.888002 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd329c-8782-49c7-ba48-8443162dbb80 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.888279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd329c-8782-49c7-ba48-8443162dbb80 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.888546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd329c-8782-49c7-ba48-8443162dbb80 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.889198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd329c-8782-49c7-ba48-8443162dbb80 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:23.890599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd329c-8782-49c7-ba48-8443162dbb80 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:23.901706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-8fcd329c-8782-49c7-ba48-8443162dbb80 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 21:36:23.902904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 404/815] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:36:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:23.903662 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd329c-8782-49c7-ba48-8443162dbb80 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:23.912026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7463af8-cf20-4103-8d96-7e867b03882e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:23.948856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2662177-e913-4390-b9f5-678546679f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:23.949519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662177-e913-4390-b9f5-678546679f28 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.949806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662177-e913-4390-b9f5-678546679f28 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.950108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662177-e913-4390-b9f5-678546679f28 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.950828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2662177-e913-4390-b9f5-678546679f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:23.951136 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2662177-e913-4390-b9f5-678546679f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:23.952490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2662177-e913-4390-b9f5-678546679f28 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:23.964338 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 412/816] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:23.965624 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baf472-9abc-451a-8138-e8ef001c93a9 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:23.965910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baf472-9abc-451a-8138-e8ef001c93a9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:23.966220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baf472-9abc-451a-8138-e8ef001c93a9 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:23.970152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 413/817] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:23.970152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baf472-9abc-451a-8138-e8ef001c93a9 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:24.009146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd329c-8782-49c7-ba48-8443162dbb80 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.042754 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79008c-35fb-41c4-892f-02dd34b215ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.043463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79008c-35fb-41c4-892f-02dd34b215ee None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.043736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79008c-35fb-41c4-892f-02dd34b215ee None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.044000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79008c-35fb-41c4-892f-02dd34b215ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.055136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79008c-35fb-41c4-892f-02dd34b215ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.056579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79008c-35fb-41c4-892f-02dd34b215ee None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.070828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baf472-9abc-451a-8138-e8ef001c93a9 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.073028 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-bc79008c-35fb-41c4-892f-02dd34b215ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:24.079082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 405/818] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:24.079082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79008c-35fb-41c4-892f-02dd34b215ee None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:24.109634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74492f6d-1d3d-4bdc-8948-43bb33986729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.110829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74492f6d-1d3d-4bdc-8948-43bb33986729 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.111110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74492f6d-1d3d-4bdc-8948-43bb33986729 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.111383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74492f6d-1d3d-4bdc-8948-43bb33986729 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.112082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74492f6d-1d3d-4bdc-8948-43bb33986729 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:24.112380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74492f6d-1d3d-4bdc-8948-43bb33986729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.113736 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74492f6d-1d3d-4bdc-8948-43bb33986729 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.118707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 414/819] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:36:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:24.119883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300d2d-a397-4ee5-9db5-2ee15648c6c7 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.120163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300d2d-a397-4ee5-9db5-2ee15648c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.120431 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c300d2d-a397-4ee5-9db5-2ee15648c6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.136730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-7c300d2d-a397-4ee5-9db5-2ee15648c6c7 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:24.138009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7c300d2d-a397-4ee5-9db5-2ee15648c6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:24.182424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79008c-35fb-41c4-892f-02dd34b215ee None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.202606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 415/820] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:24.203692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c300d2d-a397-4ee5-9db5-2ee15648c6c7 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:24.215720 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704f2a-e501-456e-8072-f1b5c610db19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.216827 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704f2a-e501-456e-8072-f1b5c610db19 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.217108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704f2a-e501-456e-8072-f1b5c610db19 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.217388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704f2a-e501-456e-8072-f1b5c610db19 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.226982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09704f2a-e501-456e-8072-f1b5c610db19 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.228428 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09704f2a-e501-456e-8072-f1b5c610db19 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.242329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-09704f2a-e501-456e-8072-f1b5c610db19 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 21:36:24.243624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 406/821] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Feb 28 21:36:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:24.244382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704f2a-e501-456e-8072-f1b5c610db19 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:24.303577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c300d2d-a397-4ee5-9db5-2ee15648c6c7 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.337445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fdd2f-94bd-4f0b-bd35-377d7b4cadbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.338132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fdd2f-94bd-4f0b-bd35-377d7b4cadbb None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.338415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fdd2f-94bd-4f0b-bd35-377d7b4cadbb None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.338686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fdd2f-94bd-4f0b-bd35-377d7b4cadbb None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.339402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fdd2f-94bd-4f0b-bd35-377d7b4cadbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:24.339704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fdd2f-94bd-4f0b-bd35-377d7b4cadbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.341062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fdd2f-94bd-4f0b-bd35-377d7b4cadbb None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.342189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704f2a-e501-456e-8072-f1b5c610db19 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.358157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 416/822] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:24.358157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fdd2f-94bd-4f0b-bd35-377d7b4cadbb None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:24.377947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57bfb9-a35a-4713-9a03-7815ccd15b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.379111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57bfb9-a35a-4713-9a03-7815ccd15b2e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.379564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57bfb9-a35a-4713-9a03-7815ccd15b2e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.380143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57bfb9-a35a-4713-9a03-7815ccd15b2e None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.381346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57bfb9-a35a-4713-9a03-7815ccd15b2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:24.382520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57bfb9-a35a-4713-9a03-7815ccd15b2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.384467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57bfb9-a35a-4713-9a03-7815ccd15b2e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.390754 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 407/823] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:36:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:24.392456 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57bfb9-a35a-4713-9a03-7815ccd15b2e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:24.475875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fdd2f-94bd-4f0b-bd35-377d7b4cadbb None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.516297 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ee07b-f30e-48de-a8b9-f2e71951af2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.517878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ee07b-f30e-48de-a8b9-f2e71951af2e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.518620 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ee07b-f30e-48de-a8b9-f2e71951af2e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.519085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ee07b-f30e-48de-a8b9-f2e71951af2e None admin] PATH_INFO: `/v3/services/network` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.520079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ee07b-f30e-48de-a8b9-f2e71951af2e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.523031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ee07b-f30e-48de-a8b9-f2e71951af2e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.523835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57bfb9-a35a-4713-9a03-7815ccd15b2e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.541113 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-637ee07b-f30e-48de-a8b9-f2e71951af2e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 28 21:36:24.543399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 417/824] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:24 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:24.544441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ee07b-f30e-48de-a8b9-f2e71951af2e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:24.577489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e57fa-2271-4ea4-99a2-8ace1077237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.577489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e57fa-2271-4ea4-99a2-8ace1077237a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.577489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e57fa-2271-4ea4-99a2-8ace1077237a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.577847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e57fa-2271-4ea4-99a2-8ace1077237a None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.579615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e57fa-2271-4ea4-99a2-8ace1077237a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:24.579615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e57fa-2271-4ea4-99a2-8ace1077237a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.581081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e57fa-2271-4ea4-99a2-8ace1077237a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.604152 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 408/825] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Feb 28 21:36:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:24.605232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e57fa-2271-4ea4-99a2-8ace1077237a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:24.666515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ee07b-f30e-48de-a8b9-f2e71951af2e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.710981 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d986d-e568-4823-a723-b2dbd925fc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.711790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d986d-e568-4823-a723-b2dbd925fc4f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.712077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d986d-e568-4823-a723-b2dbd925fc4f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.712745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d986d-e568-4823-a723-b2dbd925fc4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.721197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d986d-e568-4823-a723-b2dbd925fc4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.722874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d986d-e568-4823-a723-b2dbd925fc4f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.733584 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e57fa-2271-4ea4-99a2-8ace1077237a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.742270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-8b5d986d-e568-4823-a723-b2dbd925fc4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:24.746064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 418/826] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:24.747116 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d986d-e568-4823-a723-b2dbd925fc4f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:24.779483 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd1570-40fc-40c4-9732-b2c74eb42805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.780943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd1570-40fc-40c4-9732-b2c74eb42805 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.781422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd1570-40fc-40c4-9732-b2c74eb42805 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.782187 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd1570-40fc-40c4-9732-b2c74eb42805 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.783249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd1570-40fc-40c4-9732-b2c74eb42805 None admin] RBAC: Adding query filter params (name=network) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:24.784052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd1570-40fc-40c4-9732-b2c74eb42805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.786085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd1570-40fc-40c4-9732-b2c74eb42805 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.799950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 409/827] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:24.800629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd1570-40fc-40c4-9732-b2c74eb42805 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:24.875300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d986d-e568-4823-a723-b2dbd925fc4f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.915499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b45f4-a0bd-4af3-a6ff-de81e5709fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.916226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b45f4-a0bd-4af3-a6ff-de81e5709fcb None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.916505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b45f4-a0bd-4af3-a6ff-de81e5709fcb None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.916777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b45f4-a0bd-4af3-a6ff-de81e5709fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.932947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd1570-40fc-40c4-9732-b2c74eb42805 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:24.978403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb2fc-c873-43a5-b7f3-47bee12b257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:24.979064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb2fc-c873-43a5-b7f3-47bee12b257a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:24.979341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb2fc-c873-43a5-b7f3-47bee12b257a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:24.979613 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb2fc-c873-43a5-b7f3-47bee12b257a None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:24.980391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cb2fc-c873-43a5-b7f3-47bee12b257a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:24.980701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cb2fc-c873-43a5-b7f3-47bee12b257a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.982162 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cb2fc-c873-43a5-b7f3-47bee12b257a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.992923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b45f4-a0bd-4af3-a6ff-de81e5709fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:24.994622 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b45f4-a0bd-4af3-a6ff-de81e5709fcb None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:24.999683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 410/828] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:25.000688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb2fc-c873-43a5-b7f3-47bee12b257a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:25.108636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 419/829] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:36:25.108636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b45f4-a0bd-4af3-a6ff-de81e5709fcb None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:25.117790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb2fc-c873-43a5-b7f3-47bee12b257a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:25.152006 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f675d-daa3-4054-8443-68ce16846aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:25.152671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f675d-daa3-4054-8443-68ce16846aba None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:25.152968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f675d-daa3-4054-8443-68ce16846aba None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:25.153230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f675d-daa3-4054-8443-68ce16846aba None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:25.153941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f675d-daa3-4054-8443-68ce16846aba None admin] RBAC: Adding query filter params (type=network) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:25.154289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f675d-daa3-4054-8443-68ce16846aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:25.155655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f675d-daa3-4054-8443-68ce16846aba None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:25.165932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 411/830] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:25.165932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f675d-daa3-4054-8443-68ce16846aba None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:25.220098 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b45f4-a0bd-4af3-a6ff-de81e5709fcb None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:25.254642 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94750d4d-483b-4cf8-a9a1-53f0e94ebe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:25.256579 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94750d4d-483b-4cf8-a9a1-53f0e94ebe59 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:25.257161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94750d4d-483b-4cf8-a9a1-53f0e94ebe59 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:25.257918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94750d4d-483b-4cf8-a9a1-53f0e94ebe59 None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/3e0f83cdc2d54ced991c979f9de554a0/roles/513cc23fb1004763b19adb0e0ce40802` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:25.266863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f675d-daa3-4054-8443-68ce16846aba None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:25.273347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94750d4d-483b-4cf8-a9a1-53f0e94ebe59 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=3e0f83cdc2d54ced991c979f9de554a0, role_id=513cc23fb1004763b19adb0e0ce40802)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:25.274799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94750d4d-483b-4cf8-a9a1-53f0e94ebe59 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:25.299283 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92f24a-50bc-4c5c-b0ea-60891561bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:25.300106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f24a-50bc-4c5c-b0ea-60891561bea0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:25.300412 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f24a-50bc-4c5c-b0ea-60891561bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:25.300683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f24a-50bc-4c5c-b0ea-60891561bea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:25.311432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92f24a-50bc-4c5c-b0ea-60891561bea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:25.312870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92f24a-50bc-4c5c-b0ea-60891561bea0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:25.328786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-6e92f24a-50bc-4c5c-b0ea-60891561bea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:25.330037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 412/831] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:25.330734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92f24a-50bc-4c5c-b0ea-60891561bea0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:25.350720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 420/832] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:36:25 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/3e0f83cdc2d54ced991c979f9de554a0/roles/513cc23fb1004763b19adb0e0ce40802 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:36:25.352438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c645b9b-25fd-450f-8985-f29ccc2e2451 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:25.352951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c645b9b-25fd-450f-8985-f29ccc2e2451 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:25.353421 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c645b9b-25fd-450f-8985-f29ccc2e2451 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:25.359757 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 421/833] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:25.359757 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c645b9b-25fd-450f-8985-f29ccc2e2451 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:25.457597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92f24a-50bc-4c5c-b0ea-60891561bea0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:25.495345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c645b9b-25fd-450f-8985-f29ccc2e2451 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:25.507836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf0b3c-4d03-4e47-986b-20437cb45ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:25.508539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf0b3c-4d03-4e47-986b-20437cb45ab0 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:25.508823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf0b3c-4d03-4e47-986b-20437cb45ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:25.509100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf0b3c-4d03-4e47-986b-20437cb45ab0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:25.509898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf0b3c-4d03-4e47-986b-20437cb45ab0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:25.511971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf0b3c-4d03-4e47-986b-20437cb45ab0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:25.540179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60434be5-505d-4a55-b077-555ecc048be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:25.541208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60434be5-505d-4a55-b077-555ecc048be4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:25.541548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60434be5-505d-4a55-b077-555ecc048be4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:25.541909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60434be5-505d-4a55-b077-555ecc048be4 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:25.542853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60434be5-505d-4a55-b077-555ecc048be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:25.543265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60434be5-505d-4a55-b077-555ecc048be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:25.544683 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60434be5-505d-4a55-b077-555ecc048be4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:25.557400 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 422/834] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:25.559577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549ee26-9a2a-4e98-8b34-e8b798bfffc3 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:25.559865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549ee26-9a2a-4e98-8b34-e8b798bfffc3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:25.560206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549ee26-9a2a-4e98-8b34-e8b798bfffc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:25.581001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0549ee26-9a2a-4e98-8b34-e8b798bfffc3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:25.581364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 413/835] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Feb 28 21:36:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:25.586074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0549ee26-9a2a-4e98-8b34-e8b798bfffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:25.587551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf0b3c-4d03-4e47-986b-20437cb45ab0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:25.737576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf0b3c-4d03-4e47-986b-20437cb45ab0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:25.754189 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 423/836] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:25.798481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5076086-c720-472a-b725-57d14b24e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:25.799291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076086-c720-472a-b725-57d14b24e132 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:25.799563 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076086-c720-472a-b725-57d14b24e132 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:25.799829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076086-c720-472a-b725-57d14b24e132 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:25.805246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549ee26-9a2a-4e98-8b34-e8b798bfffc3 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:25.811244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5076086-c720-472a-b725-57d14b24e132 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:25.812716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5076086-c720-472a-b725-57d14b24e132 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:25.829564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-c5076086-c720-472a-b725-57d14b24e132 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:25.831468 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 414/837] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:25.838367 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5076086-c720-472a-b725-57d14b24e132 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:25.911929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549ee26-9a2a-4e98-8b34-e8b798bfffc3 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:25.945852 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5076086-c720-472a-b725-57d14b24e132 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:25.946684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44c5e-da14-476f-bec8-fd3fa889ae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:25.947475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44c5e-da14-476f-bec8-fd3fa889ae39 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:25.947749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44c5e-da14-476f-bec8-fd3fa889ae39 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:25.948019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44c5e-da14-476f-bec8-fd3fa889ae39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:25.958827 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a44c5e-da14-476f-bec8-fd3fa889ae39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:25.965742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a7a44c5e-da14-476f-bec8-fd3fa889ae39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:36:25.967341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 424/838] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:25.976210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44c5e-da14-476f-bec8-fd3fa889ae39 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:25.989230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c431-d91a-4a94-9e39-9dcb9e4e18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:25.990375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c431-d91a-4a94-9e39-9dcb9e4e18d3 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:25.990854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c431-d91a-4a94-9e39-9dcb9e4e18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:25.991034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c431-d91a-4a94-9e39-9dcb9e4e18d3 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:25.992156 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c431-d91a-4a94-9e39-9dcb9e4e18d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:25.992468 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c431-d91a-4a94-9e39-9dcb9e4e18d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:25.994272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c431-d91a-4a94-9e39-9dcb9e4e18d3 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:26.014181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 415/839] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:26.017558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c431-d91a-4a94-9e39-9dcb9e4e18d3 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:26.114825 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44c5e-da14-476f-bec8-fd3fa889ae39 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:26.151770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c431-d91a-4a94-9e39-9dcb9e4e18d3 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:26.158479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647d227-00bc-42b7-b7e8-b7cbec1247e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:26.159149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647d227-00bc-42b7-b7e8-b7cbec1247e6 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:26.159433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647d227-00bc-42b7-b7e8-b7cbec1247e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:26.159707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647d227-00bc-42b7-b7e8-b7cbec1247e6 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:26.160456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647d227-00bc-42b7-b7e8-b7cbec1247e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:26.160761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647d227-00bc-42b7-b7e8-b7cbec1247e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:26.163487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647d227-00bc-42b7-b7e8-b7cbec1247e6 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:26.172348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 425/840] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:26.178535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647d227-00bc-42b7-b7e8-b7cbec1247e6 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:26.192019 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b947-3fa5-4971-9270-064f2d999e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:26.193526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b947-3fa5-4971-9270-064f2d999e98 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:26.194046 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b947-3fa5-4971-9270-064f2d999e98 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:26.194514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611b947-3fa5-4971-9270-064f2d999e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:26.195552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611b947-3fa5-4971-9270-064f2d999e98 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=8182c282a5754f05b4bb6bb7057fa7ab) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:26.196053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611b947-3fa5-4971-9270-064f2d999e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:26.197830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611b947-3fa5-4971-9270-064f2d999e98 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:26.204618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 416/841] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:26 2022] GET /identity/v3/role_assignments?user.id=8182c282a5754f05b4bb6bb7057fa7ab&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:26.297361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647d227-00bc-42b7-b7e8-b7cbec1247e6 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:26.337739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d5409-2435-4454-be46-17ab9e2c60bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:26.338589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d5409-2435-4454-be46-17ab9e2c60bf None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:26.338873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d5409-2435-4454-be46-17ab9e2c60bf None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:26.339150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d5409-2435-4454-be46-17ab9e2c60bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:26.352696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d5409-2435-4454-be46-17ab9e2c60bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:26.354288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d5409-2435-4454-be46-17ab9e2c60bf None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:26.373179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-fe0d5409-2435-4454-be46-17ab9e2c60bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:26.374901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 426/842] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:26.380784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b947-3fa5-4971-9270-064f2d999e98 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:26.493767 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611b947-3fa5-4971-9270-064f2d999e98 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:26.531345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112e49-79d8-4630-be5f-6d718d71b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:26.532017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112e49-79d8-4630-be5f-6d718d71b868 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:26.532300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112e49-79d8-4630-be5f-6d718d71b868 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:26.532576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112e49-79d8-4630-be5f-6d718d71b868 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:26.533298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05112e49-79d8-4630-be5f-6d718d71b868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:26.533610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05112e49-79d8-4630-be5f-6d718d71b868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:26.535075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05112e49-79d8-4630-be5f-6d718d71b868 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:26.548327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 417/843] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:26.555064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d5409-2435-4454-be46-17ab9e2c60bf None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:26.666435 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d5409-2435-4454-be46-17ab9e2c60bf None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:26.700697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1592f1-bbc8-4a33-841f-5f3fdbcfbbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:26.701827 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1592f1-bbc8-4a33-841f-5f3fdbcfbbb1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:26.702316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1592f1-bbc8-4a33-841f-5f3fdbcfbbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:26.702782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1592f1-bbc8-4a33-841f-5f3fdbcfbbb1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:26.711501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1592f1-bbc8-4a33-841f-5f3fdbcfbbb1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:26.713248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1592f1-bbc8-4a33-841f-5f3fdbcfbbb1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:26.727182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-0c1592f1-bbc8-4a33-841f-5f3fdbcfbbb1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 28 21:36:26.732281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 427/844] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:26.734810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112e49-79d8-4630-be5f-6d718d71b868 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:26.845794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112e49-79d8-4630-be5f-6d718d71b868 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:26.857894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b710-4bea-4731-ac22-6990ee1d8aed None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:26.858215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b710-4bea-4731-ac22-6990ee1d8aed None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:26.858494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b710-4bea-4731-ac22-6990ee1d8aed None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:26.860406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 428/845] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:26.865798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa19d2-38f1-42a3-af18-03203d2be553 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:26.866356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa19d2-38f1-42a3-af18-03203d2be553 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:26.866848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa19d2-38f1-42a3-af18-03203d2be553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:26.884505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-f9aa19d2-38f1-42a3-af18-03203d2be553 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:26.886067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f9aa19d2-38f1-42a3-af18-03203d2be553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:26.890835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8304-8063-42c6-800d-bf136c2c5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:26.891516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8304-8063-42c6-800d-bf136c2c5d53 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:26.891807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8304-8063-42c6-800d-bf136c2c5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:26.892128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8304-8063-42c6-800d-bf136c2c5d53 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:26.892965 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e8304-8063-42c6-800d-bf136c2c5d53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:26.893271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e8304-8063-42c6-800d-bf136c2c5d53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:26.894748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e8304-8063-42c6-800d-bf136c2c5d53 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:26.922081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 418/846] 10.222.0.26 () {56 vars in 1135 bytes} [Mon Feb 28 21:36:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:26.925690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8304-8063-42c6-800d-bf136c2c5d53 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:26.971066 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 429/847] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:26.997810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa19d2-38f1-42a3-af18-03203d2be553 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:27.054150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8304-8063-42c6-800d-bf136c2c5d53 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:27.098255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15113040-8804-4d35-b858-3400be03e496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:27.099233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa19d2-38f1-42a3-af18-03203d2be553 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:27.100054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15113040-8804-4d35-b858-3400be03e496 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:27.100558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15113040-8804-4d35-b858-3400be03e496 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:27.101186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15113040-8804-4d35-b858-3400be03e496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:27.134608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7df9-423f-448c-b1a3-c12a012cacfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:27.135035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7df9-423f-448c-b1a3-c12a012cacfd None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:27.135314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7df9-423f-448c-b1a3-c12a012cacfd None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:27.135584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7df9-423f-448c-b1a3-c12a012cacfd None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:27.136315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce7df9-423f-448c-b1a3-c12a012cacfd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:27.137746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce7df9-423f-448c-b1a3-c12a012cacfd None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:27.180541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15113040-8804-4d35-b858-3400be03e496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:27.182357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15113040-8804-4d35-b858-3400be03e496 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:27.198289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 430/848] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:36:26 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:36:27.292995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 419/849] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 21:36:27.298741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7df9-423f-448c-b1a3-c12a012cacfd None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:27.420738 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7df9-423f-448c-b1a3-c12a012cacfd None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:27.460823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e226f-60fc-4435-bbba-3190839db97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:27.462038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e226f-60fc-4435-bbba-3190839db97b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:27.462501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e226f-60fc-4435-bbba-3190839db97b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:27.462952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e226f-60fc-4435-bbba-3190839db97b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:27.474965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e226f-60fc-4435-bbba-3190839db97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:27.476701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e226f-60fc-4435-bbba-3190839db97b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:27.494393 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-844e226f-60fc-4435-bbba-3190839db97b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:27.496210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 431/850] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:27.501492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15113040-8804-4d35-b858-3400be03e496 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:27.602172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15113040-8804-4d35-b858-3400be03e496 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:27.637160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c25bd3-9bb4-4076-9aa8-50daac7ba1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:27.638180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25bd3-9bb4-4076-9aa8-50daac7ba1ed None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:27.638641 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25bd3-9bb4-4076-9aa8-50daac7ba1ed None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:27.639102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25bd3-9bb4-4076-9aa8-50daac7ba1ed None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:27.639990 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c25bd3-9bb4-4076-9aa8-50daac7ba1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:27.640465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c25bd3-9bb4-4076-9aa8-50daac7ba1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:27.642014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c25bd3-9bb4-4076-9aa8-50daac7ba1ed None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:27.654229 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 420/851] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:27.663453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e226f-60fc-4435-bbba-3190839db97b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:27.762837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e226f-60fc-4435-bbba-3190839db97b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:27.791435 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d1512-0fda-4fef-8d66-59e0fcb0493a None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:27.791766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d1512-0fda-4fef-8d66-59e0fcb0493a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:27.791997 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d1512-0fda-4fef-8d66-59e0fcb0493a None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:27.793901 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 421/852] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:27.799280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306675-e5e1-4ef2-b6fb-2a204c7ac373 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:27.799614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306675-e5e1-4ef2-b6fb-2a204c7ac373 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:27.799973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd306675-e5e1-4ef2-b6fb-2a204c7ac373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:27.805562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28b9bf-4823-4126-b0bc-6ddb4711f156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:27.806651 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28b9bf-4823-4126-b0bc-6ddb4711f156 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:27.806934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28b9bf-4823-4126-b0bc-6ddb4711f156 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:27.807207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28b9bf-4823-4126-b0bc-6ddb4711f156 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:27.819485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28b9bf-4823-4126-b0bc-6ddb4711f156 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:27.819930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-dd306675-e5e1-4ef2-b6fb-2a204c7ac373 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:27.821021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28b9bf-4823-4126-b0bc-6ddb4711f156 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:27.821552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dd306675-e5e1-4ef2-b6fb-2a204c7ac373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:27.836355 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-ae28b9bf-4823-4126-b0bc-6ddb4711f156 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:27.842261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 432/853] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:27.843754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28b9bf-4823-4126-b0bc-6ddb4711f156 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:27.910574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 422/854] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:27.935089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306675-e5e1-4ef2-b6fb-2a204c7ac373 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:27.987643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28b9bf-4823-4126-b0bc-6ddb4711f156 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:28.032202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811670c-610d-4b75-9a40-a5b85adb7f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:28.033525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811670c-610d-4b75-9a40-a5b85adb7f9c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:28.033945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811670c-610d-4b75-9a40-a5b85adb7f9c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:28.034377 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811670c-610d-4b75-9a40-a5b85adb7f9c None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:28.035320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811670c-610d-4b75-9a40-a5b85adb7f9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:28.036222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811670c-610d-4b75-9a40-a5b85adb7f9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:28.038530 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811670c-610d-4b75-9a40-a5b85adb7f9c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:28.047888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd306675-e5e1-4ef2-b6fb-2a204c7ac373 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:28.052369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 433/855] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:28.058772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811670c-610d-4b75-9a40-a5b85adb7f9c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:28.085649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55b06b-a8f2-4c46-9ce5-fe554a3a09d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:28.087196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55b06b-a8f2-4c46-9ce5-fe554a3a09d8 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:28.087631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55b06b-a8f2-4c46-9ce5-fe554a3a09d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:28.088053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55b06b-a8f2-4c46-9ce5-fe554a3a09d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:28.103567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55b06b-a8f2-4c46-9ce5-fe554a3a09d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:28.113183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-cf55b06b-a8f2-4c46-9ce5-fe554a3a09d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:36:28.116638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 423/856] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:36:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:28.122269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55b06b-a8f2-4c46-9ce5-fe554a3a09d8 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:28.169030 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811670c-610d-4b75-9a40-a5b85adb7f9c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:28.207328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342f0cd-a975-4627-877c-1971c67f9837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:28.209338 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342f0cd-a975-4627-877c-1971c67f9837 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:28.209816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342f0cd-a975-4627-877c-1971c67f9837 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:28.210423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342f0cd-a975-4627-877c-1971c67f9837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:28.211541 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342f0cd-a975-4627-877c-1971c67f9837 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=368937ee42184e31b346ab9db570c122) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:28.212218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342f0cd-a975-4627-877c-1971c67f9837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:28.214670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342f0cd-a975-4627-877c-1971c67f9837 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:28.222468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 434/857] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:28 2022] GET /identity/v3/role_assignments?user.id=368937ee42184e31b346ab9db570c122&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:28.250277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55b06b-a8f2-4c46-9ce5-fe554a3a09d8 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:28.288771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d99d-a5e4-4c6b-8258-48bbbb06b07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:28.289383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d99d-a5e4-4c6b-8258-48bbbb06b07a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:28.289663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d99d-a5e4-4c6b-8258-48bbbb06b07a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:28.289940 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d99d-a5e4-4c6b-8258-48bbbb06b07a None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:28.290765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0d99d-a5e4-4c6b-8258-48bbbb06b07a None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:28.291071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0d99d-a5e4-4c6b-8258-48bbbb06b07a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:28.292553 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0d99d-a5e4-4c6b-8258-48bbbb06b07a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:28.303628 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 424/858] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:28.309418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342f0cd-a975-4627-877c-1971c67f9837 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:28.431934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342f0cd-a975-4627-877c-1971c67f9837 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:28.467626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d7067-5ae8-43f5-89fb-6ae27dcb4d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:28.468454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d7067-5ae8-43f5-89fb-6ae27dcb4d3d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:28.468737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d7067-5ae8-43f5-89fb-6ae27dcb4d3d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:28.469069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d7067-5ae8-43f5-89fb-6ae27dcb4d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:28.481474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d7067-5ae8-43f5-89fb-6ae27dcb4d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:28.483019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d7067-5ae8-43f5-89fb-6ae27dcb4d3d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:28.501047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-527d7067-5ae8-43f5-89fb-6ae27dcb4d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:28.502670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 435/859] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:28.508570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d99d-a5e4-4c6b-8258-48bbbb06b07a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:28.611577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0d99d-a5e4-4c6b-8258-48bbbb06b07a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:28.646937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719a43b-98b3-447a-8c43-0002c2c592a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:28.647606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719a43b-98b3-447a-8c43-0002c2c592a4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:28.647887 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719a43b-98b3-447a-8c43-0002c2c592a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:28.648159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719a43b-98b3-447a-8c43-0002c2c592a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:28.648935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719a43b-98b3-447a-8c43-0002c2c592a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:28.649239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719a43b-98b3-447a-8c43-0002c2c592a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:28.650625 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719a43b-98b3-447a-8c43-0002c2c592a4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:28.663467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 425/860] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:28.668753 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d7067-5ae8-43f5-89fb-6ae27dcb4d3d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:28.676259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9908a9f-fd1f-473d-8508-65f66ccf6f34 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:28.676543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9908a9f-fd1f-473d-8508-65f66ccf6f34 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:28.676856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9908a9f-fd1f-473d-8508-65f66ccf6f34 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:28.678657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 426/861] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:28.683559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070faa-f5ed-4fd9-9a67-f77d5de16afa None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:28.683840 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070faa-f5ed-4fd9-9a67-f77d5de16afa None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:28.684110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84070faa-f5ed-4fd9-9a67-f77d5de16afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:28.702449 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-84070faa-f5ed-4fd9-9a67-f77d5de16afa None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:28.703656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-84070faa-f5ed-4fd9-9a67-f77d5de16afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:28.778120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 427/862] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:28.787848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d7067-5ae8-43f5-89fb-6ae27dcb4d3d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:28.794252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84070faa-f5ed-4fd9-9a67-f77d5de16afa None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:28.832216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a19cb4-0a76-4ef6-8760-aad99fba2dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:28.833553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a19cb4-0a76-4ef6-8760-aad99fba2dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:28.834337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a19cb4-0a76-4ef6-8760-aad99fba2dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:28.834337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a19cb4-0a76-4ef6-8760-aad99fba2dc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:28.842105 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a19cb4-0a76-4ef6-8760-aad99fba2dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:28.869502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a19cb4-0a76-4ef6-8760-aad99fba2dc5 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:28.869502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-94a19cb4-0a76-4ef6-8760-aad99fba2dc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 21:36:28.869502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 436/863] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Feb 28 21:36:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:28.870296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a19cb4-0a76-4ef6-8760-aad99fba2dc5 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:28.894124 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84070faa-f5ed-4fd9-9a67-f77d5de16afa None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:28.930393 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec1e7f-6616-4257-94e1-615004df7619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:28.931446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec1e7f-6616-4257-94e1-615004df7619 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:28.931969 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec1e7f-6616-4257-94e1-615004df7619 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:28.932380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec1e7f-6616-4257-94e1-615004df7619 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:28.933200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec1e7f-6616-4257-94e1-615004df7619 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:28.934710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec1e7f-6616-4257-94e1-615004df7619 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:28.946703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-86ec1e7f-6616-4257-94e1-615004df7619 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 21:36:28.952898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 428/864] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Feb 28 21:36:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:28.953884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec1e7f-6616-4257-94e1-615004df7619 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:28.975238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a19cb4-0a76-4ef6-8760-aad99fba2dc5 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:29.009794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a1244-15ef-4828-afe1-b8f446b91d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:29.010496 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a1244-15ef-4828-afe1-b8f446b91d62 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:29.010793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a1244-15ef-4828-afe1-b8f446b91d62 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:29.011056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a1244-15ef-4828-afe1-b8f446b91d62 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:29.011888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a1244-15ef-4828-afe1-b8f446b91d62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:29.012190 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a1244-15ef-4828-afe1-b8f446b91d62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:29.013616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a1244-15ef-4828-afe1-b8f446b91d62 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:29.036613 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 437/865] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Feb 28 21:36:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:29.037882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a1244-15ef-4828-afe1-b8f446b91d62 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:29.056727 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec1e7f-6616-4257-94e1-615004df7619 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:29.090835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94854507-428d-4b42-a715-5cc80a008036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:29.091847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94854507-428d-4b42-a715-5cc80a008036 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:29.092317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94854507-428d-4b42-a715-5cc80a008036 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:29.092794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94854507-428d-4b42-a715-5cc80a008036 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:29.093677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94854507-428d-4b42-a715-5cc80a008036 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:29.094177 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94854507-428d-4b42-a715-5cc80a008036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:29.095800 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94854507-428d-4b42-a715-5cc80a008036 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:29.101751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 429/866] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:29.107429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94854507-428d-4b42-a715-5cc80a008036 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:29.139082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a1244-15ef-4828-afe1-b8f446b91d62 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:29.173553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17431d6a-c00a-4793-8c35-287c1c032efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:29.174243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17431d6a-c00a-4793-8c35-287c1c032efd None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:29.174528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17431d6a-c00a-4793-8c35-287c1c032efd None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:29.174806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17431d6a-c00a-4793-8c35-287c1c032efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:29.217063 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94854507-428d-4b42-a715-5cc80a008036 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:29.243990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17431d6a-c00a-4793-8c35-287c1c032efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:29.245460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17431d6a-c00a-4793-8c35-287c1c032efd None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:29.252781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a41e06-6e6a-4b69-8bcf-f2e600b4e72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:29.253828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41e06-6e6a-4b69-8bcf-f2e600b4e72f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:29.254311 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41e06-6e6a-4b69-8bcf-f2e600b4e72f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:29.254829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41e06-6e6a-4b69-8bcf-f2e600b4e72f None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:29.255756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a41e06-6e6a-4b69-8bcf-f2e600b4e72f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:29.256258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a41e06-6e6a-4b69-8bcf-f2e600b4e72f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:29.258072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a41e06-6e6a-4b69-8bcf-f2e600b4e72f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:29.263447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 430/867] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:29.363964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 438/868] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:29 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:36:29.370107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a41e06-6e6a-4b69-8bcf-f2e600b4e72f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:29.483413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a41e06-6e6a-4b69-8bcf-f2e600b4e72f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:29.519138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a158cf-34d8-4e97-863d-be8aa5c15c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:29.519941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a158cf-34d8-4e97-863d-be8aa5c15c57 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:29.520218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a158cf-34d8-4e97-863d-be8aa5c15c57 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:29.521025 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a158cf-34d8-4e97-863d-be8aa5c15c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:29.532013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a158cf-34d8-4e97-863d-be8aa5c15c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:29.533476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a158cf-34d8-4e97-863d-be8aa5c15c57 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:29.550251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-29a158cf-34d8-4e97-863d-be8aa5c15c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:29.552305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 431/869] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:29.557682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17431d6a-c00a-4793-8c35-287c1c032efd None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:29.658704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17431d6a-c00a-4793-8c35-287c1c032efd None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:29.688045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc73e9-8976-4460-abcf-c490a442be78 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:29.688369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc73e9-8976-4460-abcf-c490a442be78 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:29.688596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc73e9-8976-4460-abcf-c490a442be78 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:29.690662 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 432/870] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:29.693920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ad39e-7187-4437-954f-1e982033f3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:29.694889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ad39e-7187-4437-954f-1e982033f3dd None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:29.695172 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ad39e-7187-4437-954f-1e982033f3dd None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:29.695450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ad39e-7187-4437-954f-1e982033f3dd None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:29.695617 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00eb47-af35-4030-b549-0d22f0c86e12 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:29.695862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00eb47-af35-4030-b549-0d22f0c86e12 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:29.696134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00eb47-af35-4030-b549-0d22f0c86e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:29.696258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ad39e-7187-4437-954f-1e982033f3dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:29.696466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ad39e-7187-4437-954f-1e982033f3dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:29.698083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ad39e-7187-4437-954f-1e982033f3dd None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:29.711077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 439/871] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:29.715086 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-fe00eb47-af35-4030-b549-0d22f0c86e12 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:29.716397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ad39e-7187-4437-954f-1e982033f3dd None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:29.716611 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fe00eb47-af35-4030-b549-0d22f0c86e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:29.790148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 433/872] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:29.807109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00eb47-af35-4030-b549-0d22f0c86e12 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:29.822576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ad39e-7187-4437-954f-1e982033f3dd None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:29.862333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0986b34-b645-4f60-b882-3acb5663c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:29.863136 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0986b34-b645-4f60-b882-3acb5663c88c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:29.863417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0986b34-b645-4f60-b882-3acb5663c88c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:29.863688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0986b34-b645-4f60-b882-3acb5663c88c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:29.870953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0986b34-b645-4f60-b882-3acb5663c88c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:29.872386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0986b34-b645-4f60-b882-3acb5663c88c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:29.886883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-e0986b34-b645-4f60-b882-3acb5663c88c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:29.888084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 440/873] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:29.893704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0986b34-b645-4f60-b882-3acb5663c88c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:29.912306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00eb47-af35-4030-b549-0d22f0c86e12 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:29.947383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d04bfe-1799-49d4-add2-c0863fa1c67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:29.948195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04bfe-1799-49d4-add2-c0863fa1c67e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:29.948474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04bfe-1799-49d4-add2-c0863fa1c67e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:29.948747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d04bfe-1799-49d4-add2-c0863fa1c67e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:29.949405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d04bfe-1799-49d4-add2-c0863fa1c67e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:29.950866 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d04bfe-1799-49d4-add2-c0863fa1c67e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:29.962909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-73d04bfe-1799-49d4-add2-c0863fa1c67e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 21:36:29.964480 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 434/874] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:36:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:29.970273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d04bfe-1799-49d4-add2-c0863fa1c67e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:29.997742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0986b34-b645-4f60-b882-3acb5663c88c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:30.033363 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633256c-bccf-49eb-826f-8948ca8207bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:30.034103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633256c-bccf-49eb-826f-8948ca8207bb None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:30.034337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633256c-bccf-49eb-826f-8948ca8207bb None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:30.034617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633256c-bccf-49eb-826f-8948ca8207bb None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:30.035403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633256c-bccf-49eb-826f-8948ca8207bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:30.035707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633256c-bccf-49eb-826f-8948ca8207bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:30.037855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633256c-bccf-49eb-826f-8948ca8207bb None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:30.055051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 441/875] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:30.056053 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633256c-bccf-49eb-826f-8948ca8207bb None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:30.074286 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d04bfe-1799-49d4-add2-c0863fa1c67e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:30.108694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b06475-ae0c-4572-a1d2-9a4193090547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:30.109427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b06475-ae0c-4572-a1d2-9a4193090547 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:30.109712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b06475-ae0c-4572-a1d2-9a4193090547 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:30.109998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b06475-ae0c-4572-a1d2-9a4193090547 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:30.110739 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b06475-ae0c-4572-a1d2-9a4193090547 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:30.111042 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b06475-ae0c-4572-a1d2-9a4193090547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:30.112406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b06475-ae0c-4572-a1d2-9a4193090547 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:30.122351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 435/876] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:36:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:30.123421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b06475-ae0c-4572-a1d2-9a4193090547 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:30.166195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633256c-bccf-49eb-826f-8948ca8207bb None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:30.209604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfff1a-41ad-4d73-964c-8c1d71128e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:30.210458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfff1a-41ad-4d73-964c-8c1d71128e92 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:30.211009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfff1a-41ad-4d73-964c-8c1d71128e92 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:30.211396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfff1a-41ad-4d73-964c-8c1d71128e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:30.212632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfff1a-41ad-4d73-964c-8c1d71128e92 None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=3e0f83cdc2d54ced991c979f9de554a0) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:30.213043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfff1a-41ad-4d73-964c-8c1d71128e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:30.214599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfff1a-41ad-4d73-964c-8c1d71128e92 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:30.223231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 442/877] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:30 2022] GET /identity/v3/role_assignments?user.id=3e0f83cdc2d54ced991c979f9de554a0&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:30.227166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b06475-ae0c-4572-a1d2-9a4193090547 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:30.273582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eafbb3-1ac2-4ba8-8bab-c08b7cb59b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:30.274683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eafbb3-1ac2-4ba8-8bab-c08b7cb59b86 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:30.275160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eafbb3-1ac2-4ba8-8bab-c08b7cb59b86 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:30.275626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eafbb3-1ac2-4ba8-8bab-c08b7cb59b86 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:30.276559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eafbb3-1ac2-4ba8-8bab-c08b7cb59b86 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:30.277075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eafbb3-1ac2-4ba8-8bab-c08b7cb59b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:30.278699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eafbb3-1ac2-4ba8-8bab-c08b7cb59b86 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:30.285323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 436/878] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:36:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:30.291590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfff1a-41ad-4d73-964c-8c1d71128e92 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:30.406303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfff1a-41ad-4d73-964c-8c1d71128e92 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:30.440898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8060eb6-de77-4dcf-8e01-2de6825cbde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:30.441557 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060eb6-de77-4dcf-8e01-2de6825cbde8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:30.441835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060eb6-de77-4dcf-8e01-2de6825cbde8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:30.442141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060eb6-de77-4dcf-8e01-2de6825cbde8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:30.443279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8060eb6-de77-4dcf-8e01-2de6825cbde8 None admin] RBAC: Adding query filter params (interface=public, service_id=29d3ff380c5c438da26f9ce984752125, region_id=RegionOne) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:30.443591 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8060eb6-de77-4dcf-8e01-2de6825cbde8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:30.444942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8060eb6-de77-4dcf-8e01-2de6825cbde8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:30.450404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 443/879] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Feb 28 21:36:30 2022] GET /identity/v3/endpoints?service_id=29d3ff380c5c438da26f9ce984752125&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:30.455780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eafbb3-1ac2-4ba8-8bab-c08b7cb59b86 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:30.562322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eafbb3-1ac2-4ba8-8bab-c08b7cb59b86 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:30.600560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd53ab9-ad5a-4fb6-a4cc-9b6b67263a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:30.601288 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53ab9-ad5a-4fb6-a4cc-9b6b67263a25 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:30.601568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53ab9-ad5a-4fb6-a4cc-9b6b67263a25 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:30.601889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd53ab9-ad5a-4fb6-a4cc-9b6b67263a25 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:30.602619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53ab9-ad5a-4fb6-a4cc-9b6b67263a25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:30.603988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd53ab9-ad5a-4fb6-a4cc-9b6b67263a25 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:30.609777 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 437/880] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Feb 28 21:36:30 2022] GET /identity/v3/services => generated 1011 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:36:30.752560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad884580-c96d-4cd5-b73c-f2604d558c55 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:30.752850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad884580-c96d-4cd5-b73c-f2604d558c55 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:30.753094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad884580-c96d-4cd5-b73c-f2604d558c55 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:30.755933 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 444/881] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:30.761813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaddfe6-78ab-4f16-bc7c-e48e19ed06f5 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:30.762420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaddfe6-78ab-4f16-bc7c-e48e19ed06f5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:30.762908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaddfe6-78ab-4f16-bc7c-e48e19ed06f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:30.780583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-edaddfe6-78ab-4f16-bc7c-e48e19ed06f5 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:30.782217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-edaddfe6-78ab-4f16-bc7c-e48e19ed06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:30.858075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 438/882] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:30.878371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad884580-c96d-4cd5-b73c-f2604d558c55 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:30.985633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad884580-c96d-4cd5-b73c-f2604d558c55 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:31.020007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25eeed-f825-4436-a9e5-0dd856f06201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:31.021297 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25eeed-f825-4436-a9e5-0dd856f06201 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:31.021572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25eeed-f825-4436-a9e5-0dd856f06201 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:31.021878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25eeed-f825-4436-a9e5-0dd856f06201 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:31.022522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25eeed-f825-4436-a9e5-0dd856f06201 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:31.023877 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25eeed-f825-4436-a9e5-0dd856f06201 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:31.035406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-6d25eeed-f825-4436-a9e5-0dd856f06201 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 21:36:31.037067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 445/883] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:31.042834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaddfe6-78ab-4f16-bc7c-e48e19ed06f5 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:31.140272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaddfe6-78ab-4f16-bc7c-e48e19ed06f5 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:31.174186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8e95e-6639-456d-90c7-c3f8962ebb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:31.174857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8e95e-6639-456d-90c7-c3f8962ebb5f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:31.175142 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8e95e-6639-456d-90c7-c3f8962ebb5f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:31.175416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8e95e-6639-456d-90c7-c3f8962ebb5f None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:31.176131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8e95e-6639-456d-90c7-c3f8962ebb5f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:31.176433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8e95e-6639-456d-90c7-c3f8962ebb5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:31.178447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8e95e-6639-456d-90c7-c3f8962ebb5f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:31.183346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 439/884] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Feb 28 21:36:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:31.195070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25eeed-f825-4436-a9e5-0dd856f06201 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:31.293796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25eeed-f825-4436-a9e5-0dd856f06201 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:31.328474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee6450-07b4-4219-be6a-ce34fa438d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:31.329199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee6450-07b4-4219-be6a-ce34fa438d0b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:31.329473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee6450-07b4-4219-be6a-ce34fa438d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:31.329787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee6450-07b4-4219-be6a-ce34fa438d0b None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:31.330548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee6450-07b4-4219-be6a-ce34fa438d0b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:31.330939 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee6450-07b4-4219-be6a-ce34fa438d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:31.332487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee6450-07b4-4219-be6a-ce34fa438d0b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:31.338835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 446/885] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Feb 28 21:36:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:31.692202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e105-b942-49d7-890f-22942f5c15d1 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:31.692922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e105-b942-49d7-890f-22942f5c15d1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:31.692922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e105-b942-49d7-890f-22942f5c15d1 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:31.694959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 440/886] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:31.700208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598603aa-fb9d-49c8-9343-ae3d1c3a3bc8 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:31.700490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598603aa-fb9d-49c8-9343-ae3d1c3a3bc8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:31.700758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598603aa-fb9d-49c8-9343-ae3d1c3a3bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:31.718204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-598603aa-fb9d-49c8-9343-ae3d1c3a3bc8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:31.719380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-598603aa-fb9d-49c8-9343-ae3d1c3a3bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:31.792106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 447/887] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:31.817336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9e105-b942-49d7-890f-22942f5c15d1 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:31.923976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9e105-b942-49d7-890f-22942f5c15d1 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:31.959548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8ce5d-3bda-4aa4-a18f-9afd2ba0e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:31.960439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8ce5d-3bda-4aa4-a18f-9afd2ba0e400 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:31.960861 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8ce5d-3bda-4aa4-a18f-9afd2ba0e400 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:31.961273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8ce5d-3bda-4aa4-a18f-9afd2ba0e400 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:31.962179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8ce5d-3bda-4aa4-a18f-9afd2ba0e400 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:31.963697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8ce5d-3bda-4aa4-a18f-9afd2ba0e400 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:32.072015 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 441/888] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:36:31 2022] POST /identity/v3/services => generated 269 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:32.755057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c8481-fe7b-498a-9235-2e9db3a32732 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:32.755769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c8481-fe7b-498a-9235-2e9db3a32732 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:32.755769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c8481-fe7b-498a-9235-2e9db3a32732 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:32.758343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 448/889] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:32.763874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7fe8-ca3d-4279-835b-493221ded7e0 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:32.764306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7fe8-ca3d-4279-835b-493221ded7e0 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:32.764630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a7fe8-ca3d-4279-835b-493221ded7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:32.781668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-e30a7fe8-ca3d-4279-835b-493221ded7e0 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:32.782892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e30a7fe8-ca3d-4279-835b-493221ded7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:32.858959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 442/890] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:32.882681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c8481-fe7b-498a-9235-2e9db3a32732 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:32.987405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c8481-fe7b-498a-9235-2e9db3a32732 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:33.023064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b7810-cdc0-48e4-b3be-442e4f2bc658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:33.023806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b7810-cdc0-48e4-b3be-442e4f2bc658 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.024089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b7810-cdc0-48e4-b3be-442e4f2bc658 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.024362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b7810-cdc0-48e4-b3be-442e4f2bc658 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.035448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b7810-cdc0-48e4-b3be-442e4f2bc658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:33.043608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-d51b7810-cdc0-48e4-b3be-442e4f2bc658 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 21:36:33.045143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 449/891] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Feb 28 21:36:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:33.051046 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7fe8-ca3d-4279-835b-493221ded7e0 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:33.090228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf7b3-beae-49d1-99e0-18f8a18c9d95 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.090771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf7b3-beae-49d1-99e0-18f8a18c9d95 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.091213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf7b3-beae-49d1-99e0-18f8a18c9d95 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.097029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 450/892] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:33.099026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ea748-c096-40f4-8c8b-b6c53a4ee624 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.099469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ea748-c096-40f4-8c8b-b6c53a4ee624 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.099967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ea748-c096-40f4-8c8b-b6c53a4ee624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.117185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-a12ea748-c096-40f4-8c8b-b6c53a4ee624 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:33.118642 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a12ea748-c096-40f4-8c8b-b6c53a4ee624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:33.151927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a7fe8-ca3d-4279-835b-493221ded7e0 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:33.187164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca866db-0628-4265-b0d7-0e5ea992a72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:33.188105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca866db-0628-4265-b0d7-0e5ea992a72c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.188529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca866db-0628-4265-b0d7-0e5ea992a72c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.188943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca866db-0628-4265-b0d7-0e5ea992a72c None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.189828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca866db-0628-4265-b0d7-0e5ea992a72c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:33.190300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca866db-0628-4265-b0d7-0e5ea992a72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:33.191808 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca866db-0628-4265-b0d7-0e5ea992a72c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:33.194286 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 451/893] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:33.200815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 443/894] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Feb 28 21:36:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:33.206231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ea748-c096-40f4-8c8b-b6c53a4ee624 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:33.212815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca866db-0628-4265-b0d7-0e5ea992a72c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:33.311926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ea748-c096-40f4-8c8b-b6c53a4ee624 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:33.319070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca866db-0628-4265-b0d7-0e5ea992a72c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:33.349466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd886e-67ac-467e-92cc-98abbe8f1c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:33.350601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd886e-67ac-467e-92cc-98abbe8f1c77 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.351086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd886e-67ac-467e-92cc-98abbe8f1c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.351553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd886e-67ac-467e-92cc-98abbe8f1c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.356101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4297d8-2533-45e8-acf0-96d240bd4eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:33.356902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4297d8-2533-45e8-acf0-96d240bd4eaf None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.357180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4297d8-2533-45e8-acf0-96d240bd4eaf None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.357450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4297d8-2533-45e8-acf0-96d240bd4eaf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.358129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4297d8-2533-45e8-acf0-96d240bd4eaf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:33.359498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4297d8-2533-45e8-acf0-96d240bd4eaf None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:33.363416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd886e-67ac-467e-92cc-98abbe8f1c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:33.365673 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd886e-67ac-467e-92cc-98abbe8f1c77 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:33.371757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-6e4297d8-2533-45e8-acf0-96d240bd4eaf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 28 21:36:33.378074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 444/895] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:36:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:33.379096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4297d8-2533-45e8-acf0-96d240bd4eaf None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:33.384038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-68dd886e-67ac-467e-92cc-98abbe8f1c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:33.385650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 452/896] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:33.390937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd886e-67ac-467e-92cc-98abbe8f1c77 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:33.486661 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4297d8-2533-45e8-acf0-96d240bd4eaf None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:33.491340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd886e-67ac-467e-92cc-98abbe8f1c77 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:33.520720 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861650f-976b-46c9-9b9f-41322a358790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:33.521627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861650f-976b-46c9-9b9f-41322a358790 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.522071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861650f-976b-46c9-9b9f-41322a358790 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.522524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861650f-976b-46c9-9b9f-41322a358790 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.523423 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861650f-976b-46c9-9b9f-41322a358790 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:33.523899 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861650f-976b-46c9-9b9f-41322a358790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:33.525427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861650f-976b-46c9-9b9f-41322a358790 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:33.526126 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffea08-631f-47a8-94c0-9b31a571d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:33.526984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffea08-631f-47a8-94c0-9b31a571d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.527413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffea08-631f-47a8-94c0-9b31a571d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.527828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffea08-631f-47a8-94c0-9b31a571d5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.528725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffea08-631f-47a8-94c0-9b31a571d5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:33.529207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffea08-631f-47a8-94c0-9b31a571d5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:33.530772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffea08-631f-47a8-94c0-9b31a571d5c8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:33.535503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 445/897] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:36:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:33.537205 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861650f-976b-46c9-9b9f-41322a358790 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:33.544093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 453/898] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:33.551532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffea08-631f-47a8-94c0-9b31a571d5c8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:33.656034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861650f-976b-46c9-9b9f-41322a358790 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:33.667057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffea08-631f-47a8-94c0-9b31a571d5c8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:33.695703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9cbb5-ee14-4840-91f4-c14874cd4f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:33.696368 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9cbb5-ee14-4840-91f4-c14874cd4f98 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.696646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9cbb5-ee14-4840-91f4-c14874cd4f98 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.696915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9cbb5-ee14-4840-91f4-c14874cd4f98 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.697615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9cbb5-ee14-4840-91f4-c14874cd4f98 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:33.697918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9cbb5-ee14-4840-91f4-c14874cd4f98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:33.700261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9cbb5-ee14-4840-91f4-c14874cd4f98 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:33.702831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd69d3-cbd0-45df-a476-a1c3ab29553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:33.703880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd69d3-cbd0-45df-a476-a1c3ab29553a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.704360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd69d3-cbd0-45df-a476-a1c3ab29553a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.704830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd69d3-cbd0-45df-a476-a1c3ab29553a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.705527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 446/899] 10.222.0.26 () {56 vars in 1114 bytes} [Mon Feb 28 21:36:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:33.706766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553bc36-de93-4390-a55c-8ee8283e611d None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.707045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553bc36-de93-4390-a55c-8ee8283e611d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.707316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553bc36-de93-4390-a55c-8ee8283e611d None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.709537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 447/900] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:33.712256 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553bc36-de93-4390-a55c-8ee8283e611d None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:33.718586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd69d3-cbd0-45df-a476-a1c3ab29553a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:33.720038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd69d3-cbd0-45df-a476-a1c3ab29553a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:33.734074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-2fcd69d3-cbd0-45df-a476-a1c3ab29553a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 21:36:33.739821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 454/901] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Feb 28 21:36:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:33.740590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6257-4e15-4674-9b0a-b35c091858e9 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.740876 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6257-4e15-4674-9b0a-b35c091858e9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.741151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d6257-4e15-4674-9b0a-b35c091858e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.759895 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-321d6257-4e15-4674-9b0a-b35c091858e9 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:33.761078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-321d6257-4e15-4674-9b0a-b35c091858e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:33.826558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553bc36-de93-4390-a55c-8ee8283e611d None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:33.829159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 455/902] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:33.830050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6257-4e15-4674-9b0a-b35c091858e9 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:33.865506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e488-938e-4e38-a7ab-054e53b2b41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:33.866191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e488-938e-4e38-a7ab-054e53b2b41b None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.866472 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e488-938e-4e38-a7ab-054e53b2b41b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.866746 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3e488-938e-4e38-a7ab-054e53b2b41b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.867478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3e488-938e-4e38-a7ab-054e53b2b41b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:33.868830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3e488-938e-4e38-a7ab-054e53b2b41b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:33.940142 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d6257-4e15-4674-9b0a-b35c091858e9 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:33.945211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 448/903] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Feb 28 21:36:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:33.946246 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e488-938e-4e38-a7ab-054e53b2b41b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:33.992875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e02f0-1853-4d66-8bc8-c5edd13621eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:33.994175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e02f0-1853-4d66-8bc8-c5edd13621eb None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:33.995032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e02f0-1853-4d66-8bc8-c5edd13621eb None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:33.995768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e02f0-1853-4d66-8bc8-c5edd13621eb None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:33.996845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e02f0-1853-4d66-8bc8-c5edd13621eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:33.997349 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e02f0-1853-4d66-8bc8-c5edd13621eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:34.000169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e02f0-1853-4d66-8bc8-c5edd13621eb None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:34.025583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 456/904] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Feb 28 21:36:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:34.032071 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e02f0-1853-4d66-8bc8-c5edd13621eb None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:34.080831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3e488-938e-4e38-a7ab-054e53b2b41b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:34.120921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c09044-de6d-4392-86a0-d20cfc8ea40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:34.121667 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c09044-de6d-4392-86a0-d20cfc8ea40f None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:34.123291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c09044-de6d-4392-86a0-d20cfc8ea40f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:34.123593 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c09044-de6d-4392-86a0-d20cfc8ea40f None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:34.124351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c09044-de6d-4392-86a0-d20cfc8ea40f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:34.125757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c09044-de6d-4392-86a0-d20cfc8ea40f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:34.165663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e02f0-1853-4d66-8bc8-c5edd13621eb None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:34.175529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 449/905] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:36:33 2022] POST /identity/v3/services => generated 241 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:34.211022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7c56c-0976-4e4a-8d9b-61ed1d52f10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:34.211608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c56c-0976-4e4a-8d9b-61ed1d52f10b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:34.211889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c56c-0976-4e4a-8d9b-61ed1d52f10b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:34.212162 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7c56c-0976-4e4a-8d9b-61ed1d52f10b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:34.298163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7c56c-0976-4e4a-8d9b-61ed1d52f10b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:34.299632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7c56c-0976-4e4a-8d9b-61ed1d52f10b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:34.407587 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 457/906] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:34 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:36:34.413396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c09044-de6d-4392-86a0-d20cfc8ea40f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:34.450232 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a5400-f411-45a9-988f-bfb9c7176bde None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:34.450796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a5400-f411-45a9-988f-bfb9c7176bde None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:34.451245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a5400-f411-45a9-988f-bfb9c7176bde None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:34.454606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 458/907] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:34.460924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff082f5-1de8-44b5-b727-419bafcddfa6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:34.461509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff082f5-1de8-44b5-b727-419bafcddfa6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:34.461951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff082f5-1de8-44b5-b727-419bafcddfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:34.478920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-8ff082f5-1de8-44b5-b727-419bafcddfa6 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:34.480350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-8ff082f5-1de8-44b5-b727-419bafcddfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:34.519851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c09044-de6d-4392-86a0-d20cfc8ea40f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:34.553209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 459/908] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:34.556925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4739f-75d6-4a82-8777-e5f32af51b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:34.557894 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4739f-75d6-4a82-8777-e5f32af51b9b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:34.558345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4739f-75d6-4a82-8777-e5f32af51b9b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:34.558796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4739f-75d6-4a82-8777-e5f32af51b9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:34.569897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4739f-75d6-4a82-8777-e5f32af51b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:34.572262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff082f5-1de8-44b5-b727-419bafcddfa6 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:34.574607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4739f-75d6-4a82-8777-e5f32af51b9b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:34.595707 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-f2e4739f-75d6-4a82-8777-e5f32af51b9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:34.602945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 450/909] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:34.604791 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4739f-75d6-4a82-8777-e5f32af51b9b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:34.696145 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff082f5-1de8-44b5-b727-419bafcddfa6 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:34.723556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4739f-75d6-4a82-8777-e5f32af51b9b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:34.739602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa8bc4-448b-4ca6-a62b-626cd987c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:34.740802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa8bc4-448b-4ca6-a62b-626cd987c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:34.741087 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa8bc4-448b-4ca6-a62b-626cd987c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:34.741357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa8bc4-448b-4ca6-a62b-626cd987c6b0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:34.742328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa8bc4-448b-4ca6-a62b-626cd987c6b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:34.743866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa8bc4-448b-4ca6-a62b-626cd987c6b0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:34.759215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-69aa8bc4-448b-4ca6-a62b-626cd987c6b0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 21:36:34.760951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 460/910] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Feb 28 21:36:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:34.767284 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe8f9-7595-485f-ade4-42493727ac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:34.767952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe8f9-7595-485f-ade4-42493727ac6f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:34.768227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe8f9-7595-485f-ade4-42493727ac6f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:34.768497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe8f9-7595-485f-ade4-42493727ac6f None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:34.769215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbe8f9-7595-485f-ade4-42493727ac6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:34.769516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbe8f9-7595-485f-ade4-42493727ac6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:34.771393 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa8bc4-448b-4ca6-a62b-626cd987c6b0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:34.771865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbe8f9-7595-485f-ade4-42493727ac6f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:34.784714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 451/911] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:34.792776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe8f9-7595-485f-ade4-42493727ac6f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:34.883470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa8bc4-448b-4ca6-a62b-626cd987c6b0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:34.898265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe8f9-7595-485f-ade4-42493727ac6f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:34.920416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ed71d-0cb0-4a89-8f02-b14a521cfd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:34.921167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ed71d-0cb0-4a89-8f02-b14a521cfd64 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:34.921385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ed71d-0cb0-4a89-8f02-b14a521cfd64 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:34.921623 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ed71d-0cb0-4a89-8f02-b14a521cfd64 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:34.922389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ed71d-0cb0-4a89-8f02-b14a521cfd64 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:34.922673 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ed71d-0cb0-4a89-8f02-b14a521cfd64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:34.924019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ed71d-0cb0-4a89-8f02-b14a521cfd64 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:34.933558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 461/912] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:34.934861 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ed71d-0cb0-4a89-8f02-b14a521cfd64 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:34.936786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dcd9d-8e99-4e61-8dca-f364db5b627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:34.937842 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dcd9d-8e99-4e61-8dca-f364db5b627b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:34.938345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dcd9d-8e99-4e61-8dca-f364db5b627b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:34.938828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dcd9d-8e99-4e61-8dca-f364db5b627b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:34.946338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dcd9d-8e99-4e61-8dca-f364db5b627b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:34.948049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dcd9d-8e99-4e61-8dca-f364db5b627b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:34.962376 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-449dcd9d-8e99-4e61-8dca-f364db5b627b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:34.964104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 452/913] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:34.969608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dcd9d-8e99-4e61-8dca-f364db5b627b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:35.054453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ed71d-0cb0-4a89-8f02-b14a521cfd64 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:35.079029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dcd9d-8e99-4e61-8dca-f364db5b627b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:35.089255 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32fd80-ce3d-460d-9a21-57de51811cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:35.089919 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32fd80-ce3d-460d-9a21-57de51811cce None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:35.090227 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32fd80-ce3d-460d-9a21-57de51811cce None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:35.090498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32fd80-ce3d-460d-9a21-57de51811cce None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:35.091197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32fd80-ce3d-460d-9a21-57de51811cce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:35.091496 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32fd80-ce3d-460d-9a21-57de51811cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:35.092848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32fd80-ce3d-460d-9a21-57de51811cce None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:35.103306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 462/914] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:35.104618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32fd80-ce3d-460d-9a21-57de51811cce None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:35.116535 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0295fb5-4495-418f-befe-bbea842ab903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:35.117204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0295fb5-4495-418f-befe-bbea842ab903 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:35.117541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0295fb5-4495-418f-befe-bbea842ab903 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:35.117816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0295fb5-4495-418f-befe-bbea842ab903 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:35.118691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0295fb5-4495-418f-befe-bbea842ab903 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:35.118999 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0295fb5-4495-418f-befe-bbea842ab903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:35.120438 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0295fb5-4495-418f-befe-bbea842ab903 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:35.134824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 453/915] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:35.141274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0295fb5-4495-418f-befe-bbea842ab903 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:35.226926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32fd80-ce3d-460d-9a21-57de51811cce None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:35.262888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff7c98-6758-4489-ba57-c76e6d4ca592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:35.263574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff7c98-6758-4489-ba57-c76e6d4ca592 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:35.263898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff7c98-6758-4489-ba57-c76e6d4ca592 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:35.264176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff7c98-6758-4489-ba57-c76e6d4ca592 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:35.264962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff7c98-6758-4489-ba57-c76e6d4ca592 None admin] RBAC: Adding query filter params (interface=public, service_id=2c74adffccd64824a6cc7674bf4efd5e, region_id=RegionOne) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:35.265273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff7c98-6758-4489-ba57-c76e6d4ca592 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:35.266680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff7c98-6758-4489-ba57-c76e6d4ca592 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:35.272558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0295fb5-4495-418f-befe-bbea842ab903 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:35.277749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 463/916] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Feb 28 21:36:35 2022] GET /identity/v3/endpoints?service_id=2c74adffccd64824a6cc7674bf4efd5e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:35.279451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff7c98-6758-4489-ba57-c76e6d4ca592 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:35.317551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af5152-401c-4b80-a8f6-8b4ef4394143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:35.319371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af5152-401c-4b80-a8f6-8b4ef4394143 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:35.319853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af5152-401c-4b80-a8f6-8b4ef4394143 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:35.320338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af5152-401c-4b80-a8f6-8b4ef4394143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:35.321353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af5152-401c-4b80-a8f6-8b4ef4394143 None admin] RBAC: Adding query filter params (role.id=27d9513a3f8d4f59a5005e708bbbf4b5, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=3e0f83cdc2d54ced991c979f9de554a0) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:35.321868 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af5152-401c-4b80-a8f6-8b4ef4394143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:35.323915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af5152-401c-4b80-a8f6-8b4ef4394143 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:35.338239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 454/917] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:35 2022] GET /identity/v3/role_assignments?user.id=3e0f83cdc2d54ced991c979f9de554a0&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=27d9513a3f8d4f59a5005e708bbbf4b5 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:35.397942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff7c98-6758-4489-ba57-c76e6d4ca592 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:35.435188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425810b-c6df-4d9d-b53e-cc7e7e4cd741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:35.435915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425810b-c6df-4d9d-b53e-cc7e7e4cd741 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:35.436202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425810b-c6df-4d9d-b53e-cc7e7e4cd741 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:35.436477 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425810b-c6df-4d9d-b53e-cc7e7e4cd741 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:35.437166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425810b-c6df-4d9d-b53e-cc7e7e4cd741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:35.438649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425810b-c6df-4d9d-b53e-cc7e7e4cd741 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:35.446375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 464/918] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Feb 28 21:36:35 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:36:36.415907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc05b9-efec-4273-bf1c-5f4d444b11a5 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:36.416423 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc05b9-efec-4273-bf1c-5f4d444b11a5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:36.416497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc05b9-efec-4273-bf1c-5f4d444b11a5 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:36.418475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 455/919] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:36.423875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a11cc8-f146-4ccd-ba8d-5ba59f7d22d8 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:36.424286 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a11cc8-f146-4ccd-ba8d-5ba59f7d22d8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:36.424453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a11cc8-f146-4ccd-ba8d-5ba59f7d22d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:36.442172 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-f3a11cc8-f146-4ccd-ba8d-5ba59f7d22d8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:36.443365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f3a11cc8-f146-4ccd-ba8d-5ba59f7d22d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:36.516021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 465/920] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:36.539803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc05b9-efec-4273-bf1c-5f4d444b11a5 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:36.567959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2559996-e964-494e-a7f0-2e9b76687de3 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:36.568245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2559996-e964-494e-a7f0-2e9b76687de3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:36.568532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2559996-e964-494e-a7f0-2e9b76687de3 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:36.570356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 466/921] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:36.575472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c483-0a91-4742-8c81-0c1119af9463 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:36.575751 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c483-0a91-4742-8c81-0c1119af9463 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:36.576023 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c483-0a91-4742-8c81-0c1119af9463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:36.596529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-43d4c483-0a91-4742-8c81-0c1119af9463 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:36.597701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-43d4c483-0a91-4742-8c81-0c1119af9463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:36.659557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc05b9-efec-4273-bf1c-5f4d444b11a5 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:36.674314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 467/922] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:36.690938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c483-0a91-4742-8c81-0c1119af9463 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:36.695619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:36.696279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:36.696555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:36.696823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:36.697531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:36.698991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:36.700328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.common [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 28 21:36:36.757184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.sql.core [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 28 21:36:36.757184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 28 21:36:36.757184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [parameters: {'id': '1e956f2c2999466988929b9101df7ba9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 28 21:36:36.757184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 21:36:36.777960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e956f2c2999466988929b9101df7ba9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1e956f2c2999466988929b9101df7ba9. Feb 28 21:36:36.785484 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 456/923] 10.222.0.26 () {60 vars in 1140 bytes} [Mon Feb 28 21:36:36 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:36.787509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:36.808665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c483-0a91-4742-8c81-0c1119af9463 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:36.855097 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9398ca0-789e-4e57-bf7c-f1b4ecdf6143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:36.856271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9398ca0-789e-4e57-bf7c-f1b4ecdf6143 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:36.856271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9398ca0-789e-4e57-bf7c-f1b4ecdf6143 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:36.856493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9398ca0-789e-4e57-bf7c-f1b4ecdf6143 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:36.857365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9398ca0-789e-4e57-bf7c-f1b4ecdf6143 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:36.858678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9398ca0-789e-4e57-bf7c-f1b4ecdf6143 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:36.871517 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-c9398ca0-789e-4e57-bf7c-f1b4ecdf6143 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 21:36:36.877843 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 468/924] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:36.878876 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9398ca0-789e-4e57-bf7c-f1b4ecdf6143 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:36.911876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05e0c1-8a8e-4c00-b06e-1f56783cb3c9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:36.945552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014747f-ee42-4316-806c-545639004253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:36.946716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014747f-ee42-4316-806c-545639004253 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:36.947198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014747f-ee42-4316-806c-545639004253 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:36.947670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014747f-ee42-4316-806c-545639004253 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:36.954748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014747f-ee42-4316-806c-545639004253 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:36.956731 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014747f-ee42-4316-806c-545639004253 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:36.971803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-2014747f-ee42-4316-806c-545639004253 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:36.978921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 457/925] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:36.979987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014747f-ee42-4316-806c-545639004253 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:36.984312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9398ca0-789e-4e57-bf7c-f1b4ecdf6143 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:37.018978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0fd62-664e-4fb5-a1ee-73acab71ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:37.019637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fd62-664e-4fb5-a1ee-73acab71ec8b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:37.019917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fd62-664e-4fb5-a1ee-73acab71ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:37.020777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fd62-664e-4fb5-a1ee-73acab71ec8b None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:37.021486 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fd62-664e-4fb5-a1ee-73acab71ec8b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:37.021837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fd62-664e-4fb5-a1ee-73acab71ec8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:37.023284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fd62-664e-4fb5-a1ee-73acab71ec8b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:37.028542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 469/926] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Feb 28 21:36:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:37.033983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0fd62-664e-4fb5-a1ee-73acab71ec8b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:37.084646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014747f-ee42-4316-806c-545639004253 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:37.119905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f5395-4e9e-48ac-a0f9-adf79558478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:37.120919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f5395-4e9e-48ac-a0f9-adf79558478a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:37.121399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f5395-4e9e-48ac-a0f9-adf79558478a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:37.121869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f5395-4e9e-48ac-a0f9-adf79558478a None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:37.123073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f5395-4e9e-48ac-a0f9-adf79558478a None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:37.123600 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f5395-4e9e-48ac-a0f9-adf79558478a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:37.125307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f5395-4e9e-48ac-a0f9-adf79558478a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:37.135724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0fd62-664e-4fb5-a1ee-73acab71ec8b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:37.154130 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 458/927] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:36 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:37.173269 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b593a6-daea-44b5-8429-707d4f1cc1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:37.173951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b593a6-daea-44b5-8429-707d4f1cc1f1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:37.174304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b593a6-daea-44b5-8429-707d4f1cc1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:37.174590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b593a6-daea-44b5-8429-707d4f1cc1f1 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:37.175310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b593a6-daea-44b5-8429-707d4f1cc1f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:37.175614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b593a6-daea-44b5-8429-707d4f1cc1f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:37.177575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b593a6-daea-44b5-8429-707d4f1cc1f1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:37.184274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 470/928] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Feb 28 21:36:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:37.190386 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f5395-4e9e-48ac-a0f9-adf79558478a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:37.298979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f5395-4e9e-48ac-a0f9-adf79558478a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:37.340419 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf38e74-ecaa-4b9a-bac5-7ea71e1b7584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:37.341493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38e74-ecaa-4b9a-bac5-7ea71e1b7584 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:37.341983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38e74-ecaa-4b9a-bac5-7ea71e1b7584 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:37.342507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38e74-ecaa-4b9a-bac5-7ea71e1b7584 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:37.343510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf38e74-ecaa-4b9a-bac5-7ea71e1b7584 None admin] RBAC: Adding query filter params (interface=public, service_id=45fa9b911258435f8778b0c8c8d66ecc, region_id=RegionOne) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:37.344022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf38e74-ecaa-4b9a-bac5-7ea71e1b7584 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:37.345630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf38e74-ecaa-4b9a-bac5-7ea71e1b7584 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:37.352979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 459/929] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Feb 28 21:36:37 2022] GET /identity/v3/endpoints?service_id=45fa9b911258435f8778b0c8c8d66ecc&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:37.358210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b593a6-daea-44b5-8429-707d4f1cc1f1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:37.474967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b593a6-daea-44b5-8429-707d4f1cc1f1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:37.511103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73018ce3-f9ab-4622-9592-e22951dce6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:37.511772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73018ce3-f9ab-4622-9592-e22951dce6a9 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:37.512060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73018ce3-f9ab-4622-9592-e22951dce6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:37.512335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73018ce3-f9ab-4622-9592-e22951dce6a9 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:37.513019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73018ce3-f9ab-4622-9592-e22951dce6a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:37.514416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73018ce3-f9ab-4622-9592-e22951dce6a9 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:37.521037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 471/930] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Feb 28 21:36:37 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:36:37.782513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd587e97-d7a2-4e0c-bb09-ac7fa1b82838 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:37.783029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd587e97-d7a2-4e0c-bb09-ac7fa1b82838 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:37.783104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd587e97-d7a2-4e0c-bb09-ac7fa1b82838 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:37.785108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 460/931] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:37.792184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a2b26-3cc4-4366-9c00-57759ae89a3d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:37.792484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a2b26-3cc4-4366-9c00-57759ae89a3d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:37.792767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a2b26-3cc4-4366-9c00-57759ae89a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:37.810617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-052a2b26-3cc4-4366-9c00-57759ae89a3d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:37.811809 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-052a2b26-3cc4-4366-9c00-57759ae89a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:37.834820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98819-8115-48f1-b2f7-97ec72080bca None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:37.835120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98819-8115-48f1-b2f7-97ec72080bca None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:37.835363 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f98819-8115-48f1-b2f7-97ec72080bca None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:37.837257 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 461/932] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:37.842683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47484b-d05e-4796-acba-05b8ecf340a3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:37.849067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47484b-d05e-4796-acba-05b8ecf340a3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:37.849067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47484b-d05e-4796-acba-05b8ecf340a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:37.867256 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6a47484b-d05e-4796-acba-05b8ecf340a3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:37.869145 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6a47484b-d05e-4796-acba-05b8ecf340a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:37.886023 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 472/933] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:37.909964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a2b26-3cc4-4366-9c00-57759ae89a3d None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:37.954420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 462/934] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:37.978903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47484b-d05e-4796-acba-05b8ecf340a3 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:38.032644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a2b26-3cc4-4366-9c00-57759ae89a3d None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:38.075529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aac8d-f382-40df-bbe0-e5fd280b6c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:38.076298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aac8d-f382-40df-bbe0-e5fd280b6c2e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:38.076632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aac8d-f382-40df-bbe0-e5fd280b6c2e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:38.076912 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aac8d-f382-40df-bbe0-e5fd280b6c2e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:38.085277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47484b-d05e-4796-acba-05b8ecf340a3 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:38.088602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aac8d-f382-40df-bbe0-e5fd280b6c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:38.095491 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-f12aac8d-f382-40df-bbe0-e5fd280b6c2e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 21:36:38.102251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 473/935] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Feb 28 21:36:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:38.103091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aac8d-f382-40df-bbe0-e5fd280b6c2e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:38.124252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b182-875f-46ff-9dc3-cf7e3ace5857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:38.125467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b182-875f-46ff-9dc3-cf7e3ace5857 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:38.125943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b182-875f-46ff-9dc3-cf7e3ace5857 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:38.126435 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b182-875f-46ff-9dc3-cf7e3ace5857 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:38.127443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94b182-875f-46ff-9dc3-cf7e3ace5857 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:38.129000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94b182-875f-46ff-9dc3-cf7e3ace5857 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:38.140933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-6b94b182-875f-46ff-9dc3-cf7e3ace5857 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 28 21:36:38.147586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 463/936] 10.222.0.26 () {56 vars in 1132 bytes} [Mon Feb 28 21:36:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:38.149334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b182-875f-46ff-9dc3-cf7e3ace5857 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:38.207706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aac8d-f382-40df-bbe0-e5fd280b6c2e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:38.242969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742830a-64b0-4629-a8a9-ff4a1848e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:38.243697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742830a-64b0-4629-a8a9-ff4a1848e366 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:38.243977 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742830a-64b0-4629-a8a9-ff4a1848e366 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:38.244252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742830a-64b0-4629-a8a9-ff4a1848e366 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:38.245046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742830a-64b0-4629-a8a9-ff4a1848e366 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:38.245360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742830a-64b0-4629-a8a9-ff4a1848e366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:38.246754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742830a-64b0-4629-a8a9-ff4a1848e366 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:38.256108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 474/937] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Feb 28 21:36:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:38.261420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742830a-64b0-4629-a8a9-ff4a1848e366 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:38.277278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b182-875f-46ff-9dc3-cf7e3ace5857 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:38.318056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751de60f-3387-4a26-bd4c-bd163c61badc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:38.318733 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751de60f-3387-4a26-bd4c-bd163c61badc None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:38.319010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751de60f-3387-4a26-bd4c-bd163c61badc None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:38.319280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751de60f-3387-4a26-bd4c-bd163c61badc None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:38.319982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751de60f-3387-4a26-bd4c-bd163c61badc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:38.320278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751de60f-3387-4a26-bd4c-bd163c61badc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:38.321628 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751de60f-3387-4a26-bd4c-bd163c61badc None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:38.326870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 464/938] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:38.333534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751de60f-3387-4a26-bd4c-bd163c61badc None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:38.372670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742830a-64b0-4629-a8a9-ff4a1848e366 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:38.408061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388ec9-f5d4-403e-8500-b5a1a3377ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:38.408909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388ec9-f5d4-403e-8500-b5a1a3377ecf None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:38.409195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388ec9-f5d4-403e-8500-b5a1a3377ecf None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:38.409467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388ec9-f5d4-403e-8500-b5a1a3377ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:38.423521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64388ec9-f5d4-403e-8500-b5a1a3377ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:38.424968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64388ec9-f5d4-403e-8500-b5a1a3377ecf None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:38.440633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751de60f-3387-4a26-bd4c-bd163c61badc None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:38.447493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-64388ec9-f5d4-403e-8500-b5a1a3377ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:38.449090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 475/939] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:38.454383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388ec9-f5d4-403e-8500-b5a1a3377ecf None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:38.482079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe112222-d77f-401c-afce-52c42186e26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:38.482985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe112222-d77f-401c-afce-52c42186e26a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:38.483325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe112222-d77f-401c-afce-52c42186e26a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:38.483978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe112222-d77f-401c-afce-52c42186e26a None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:38.485033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe112222-d77f-401c-afce-52c42186e26a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:38.485415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe112222-d77f-401c-afce-52c42186e26a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:38.487339 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe112222-d77f-401c-afce-52c42186e26a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:38.495141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 465/940] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:38.503820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe112222-d77f-401c-afce-52c42186e26a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:38.567753 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388ec9-f5d4-403e-8500-b5a1a3377ecf None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:38.602127 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349b5ba-1a8a-4cb7-a42a-3221295cef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:38.603033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349b5ba-1a8a-4cb7-a42a-3221295cef75 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:38.603455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349b5ba-1a8a-4cb7-a42a-3221295cef75 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:38.603864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349b5ba-1a8a-4cb7-a42a-3221295cef75 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:38.604706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349b5ba-1a8a-4cb7-a42a-3221295cef75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:38.605208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349b5ba-1a8a-4cb7-a42a-3221295cef75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:38.606779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349b5ba-1a8a-4cb7-a42a-3221295cef75 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:38.627351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 476/941] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:38.628438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349b5ba-1a8a-4cb7-a42a-3221295cef75 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:38.632142 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe112222-d77f-401c-afce-52c42186e26a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:38.667324 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a250cbb-2e24-4762-9903-033b794f2abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:38.668422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a250cbb-2e24-4762-9903-033b794f2abb None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:38.668909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a250cbb-2e24-4762-9903-033b794f2abb None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:38.669318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a250cbb-2e24-4762-9903-033b794f2abb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:38.670225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a250cbb-2e24-4762-9903-033b794f2abb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:38.671742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a250cbb-2e24-4762-9903-033b794f2abb None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:38.727277 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349b5ba-1a8a-4cb7-a42a-3221295cef75 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:38.735612 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 466/942] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Feb 28 21:36:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:38.780450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573201e-fdcd-48a4-bd4c-6df9ec5e7e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:38.781725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573201e-fdcd-48a4-bd4c-6df9ec5e7e89 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:38.782286 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573201e-fdcd-48a4-bd4c-6df9ec5e7e89 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:38.782811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573201e-fdcd-48a4-bd4c-6df9ec5e7e89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:38.791852 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573201e-fdcd-48a4-bd4c-6df9ec5e7e89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:38.793873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573201e-fdcd-48a4-bd4c-6df9ec5e7e89 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:38.811315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-5573201e-fdcd-48a4-bd4c-6df9ec5e7e89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 21:36:38.813366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 477/943] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Feb 28 21:36:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:38.819396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a250cbb-2e24-4762-9903-033b794f2abb None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:38.941704 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a250cbb-2e24-4762-9903-033b794f2abb None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:38.975713 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9a353-18b9-49e5-b55e-5bd93490af70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:38.976391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9a353-18b9-49e5-b55e-5bd93490af70 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:38.976667 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9a353-18b9-49e5-b55e-5bd93490af70 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:38.976940 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9a353-18b9-49e5-b55e-5bd93490af70 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:38.977773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9a353-18b9-49e5-b55e-5bd93490af70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:38.978098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9a353-18b9-49e5-b55e-5bd93490af70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:38.979539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9a353-18b9-49e5-b55e-5bd93490af70 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:38.997598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 467/944] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Feb 28 21:36:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:39.002798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573201e-fdcd-48a4-bd4c-6df9ec5e7e89 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:39.103176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573201e-fdcd-48a4-bd4c-6df9ec5e7e89 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:39.138637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f07828-0c73-4090-aa76-a46d75d22f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:39.139348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f07828-0c73-4090-aa76-a46d75d22f4f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:39.139626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f07828-0c73-4090-aa76-a46d75d22f4f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:39.139895 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f07828-0c73-4090-aa76-a46d75d22f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:39.150639 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f07828-0c73-4090-aa76-a46d75d22f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:39.152074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f07828-0c73-4090-aa76-a46d75d22f4f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:39.169774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-17f07828-0c73-4090-aa76-a46d75d22f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:39.171378 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 478/945] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:39.176901 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9a353-18b9-49e5-b55e-5bd93490af70 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:39.283242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9a353-18b9-49e5-b55e-5bd93490af70 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:39.319532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84bc82-586f-47d8-888c-19c77115e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:39.320600 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bc82-586f-47d8-888c-19c77115e195 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:39.321118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bc82-586f-47d8-888c-19c77115e195 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:39.321591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bc82-586f-47d8-888c-19c77115e195 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:39.322579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84bc82-586f-47d8-888c-19c77115e195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:39.323095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84bc82-586f-47d8-888c-19c77115e195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:39.324724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84bc82-586f-47d8-888c-19c77115e195 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:39.339218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 468/946] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:39.350083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f07828-0c73-4090-aa76-a46d75d22f4f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:39.442641 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f07828-0c73-4090-aa76-a46d75d22f4f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:39.477721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd56ff-f5f5-4d32-b9d4-6d525c2cd602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:39.478620 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd56ff-f5f5-4d32-b9d4-6d525c2cd602 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:39.478897 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd56ff-f5f5-4d32-b9d4-6d525c2cd602 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:39.479167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd56ff-f5f5-4d32-b9d4-6d525c2cd602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:39.486020 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd56ff-f5f5-4d32-b9d4-6d525c2cd602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:39.487507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd56ff-f5f5-4d32-b9d4-6d525c2cd602 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:39.501013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-9efd56ff-f5f5-4d32-b9d4-6d525c2cd602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:39.502649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 479/947] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:39.509528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84bc82-586f-47d8-888c-19c77115e195 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:39.613409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84bc82-586f-47d8-888c-19c77115e195 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:39.647782 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16f1e7-e099-4087-a481-a14bb1e2f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:39.648448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16f1e7-e099-4087-a481-a14bb1e2f94f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:39.648724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16f1e7-e099-4087-a481-a14bb1e2f94f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:39.648992 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16f1e7-e099-4087-a481-a14bb1e2f94f None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:39.649766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16f1e7-e099-4087-a481-a14bb1e2f94f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:39.650104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16f1e7-e099-4087-a481-a14bb1e2f94f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:39.651557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16f1e7-e099-4087-a481-a14bb1e2f94f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:39.664865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 469/948] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:39.670650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd56ff-f5f5-4d32-b9d4-6d525c2cd602 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:39.682688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8751893-4b5f-491b-9bde-4da5f2682324 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:39.682958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8751893-4b5f-491b-9bde-4da5f2682324 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:39.683619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8751893-4b5f-491b-9bde-4da5f2682324 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:39.686272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 470/949] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:39.693146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a65d32-01e6-43f3-b53d-987737680dd0 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:39.693440 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a65d32-01e6-43f3-b53d-987737680dd0 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:39.693715 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a65d32-01e6-43f3-b53d-987737680dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:39.713123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-31a65d32-01e6-43f3-b53d-987737680dd0 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:39.715554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-31a65d32-01e6-43f3-b53d-987737680dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:39.788142 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd56ff-f5f5-4d32-b9d4-6d525c2cd602 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:39.804494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 471/950] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:39.828020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a65d32-01e6-43f3-b53d-987737680dd0 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:39.838824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad92b24-7999-443d-9ebc-6b85ae1fabfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:39.847418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad92b24-7999-443d-9ebc-6b85ae1fabfe None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:39.847418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad92b24-7999-443d-9ebc-6b85ae1fabfe None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:39.847418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad92b24-7999-443d-9ebc-6b85ae1fabfe None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/3e0f83cdc2d54ced991c979f9de554a0/roles/27d9513a3f8d4f59a5005e708bbbf4b5` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:39.847418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad92b24-7999-443d-9ebc-6b85ae1fabfe None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=3e0f83cdc2d54ced991c979f9de554a0, role_id=27d9513a3f8d4f59a5005e708bbbf4b5)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:39.847418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad92b24-7999-443d-9ebc-6b85ae1fabfe None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:39.934058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a65d32-01e6-43f3-b53d-987737680dd0 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:39.949906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 480/951] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:36:39 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/3e0f83cdc2d54ced991c979f9de554a0/roles/27d9513a3f8d4f59a5005e708bbbf4b5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:36:39.955522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728790b-f99b-45d9-a264-7cf3258a27d9 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:39.955811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728790b-f99b-45d9-a264-7cf3258a27d9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:39.956252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728790b-f99b-45d9-a264-7cf3258a27d9 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:39.970915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 481/952] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:39 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:39.972607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a790e-5f28-4133-9f6c-6879d66477f7 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:39.972892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a790e-5f28-4133-9f6c-6879d66477f7 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:39.973786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a790e-5f28-4133-9f6c-6879d66477f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:39.974349 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53916-351f-4cfb-8919-aaf37f0fb020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:39.975031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53916-351f-4cfb-8919-aaf37f0fb020 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:39.975301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53916-351f-4cfb-8919-aaf37f0fb020 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:39.975570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc53916-351f-4cfb-8919-aaf37f0fb020 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:39.976284 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc53916-351f-4cfb-8919-aaf37f0fb020 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:39.977742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc53916-351f-4cfb-8919-aaf37f0fb020 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:40.009528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e15a790e-5f28-4133-9f6c-6879d66477f7 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:40.010824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e15a790e-5f28-4133-9f6c-6879d66477f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:40.013039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.sql.core [None req-5cc53916-351f-4cfb-8919-aaf37f0fb020 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 28 21:36:40.013039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 28 21:36:40.013039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [parameters: {'user_id': 'c08fe207ee5749ce9e153882ae8a1316', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 28 21:36:40.013039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 28 21:36:40.019048 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-5cc53916-351f-4cfb-8919-aaf37f0fb020 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 28 21:36:40.021266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 472/953] 10.222.0.26 () {60 vars in 1131 bytes} [Mon Feb 28 21:36:39 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:40.027887 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53916-351f-4cfb-8919-aaf37f0fb020 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:40.109383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 482/954] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:40.134564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a790e-5f28-4133-9f6c-6879d66477f7 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:40.163609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc53916-351f-4cfb-8919-aaf37f0fb020 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:40.206714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914daba-c245-44bb-af58-00691a3bfdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:40.208003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914daba-c245-44bb-af58-00691a3bfdb3 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:40.208496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914daba-c245-44bb-af58-00691a3bfdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:40.208893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914daba-c245-44bb-af58-00691a3bfdb3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:40.217410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914daba-c245-44bb-af58-00691a3bfdb3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:40.219231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914daba-c245-44bb-af58-00691a3bfdb3 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:40.237507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-2914daba-c245-44bb-af58-00691a3bfdb3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 28 21:36:40.239551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 473/955] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:40.245728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914daba-c245-44bb-af58-00691a3bfdb3 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:40.261237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a790e-5f28-4133-9f6c-6879d66477f7 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:40.303376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba771c-8f91-40e4-980f-ba21149a291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:40.304561 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba771c-8f91-40e4-980f-ba21149a291a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:40.305045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba771c-8f91-40e4-980f-ba21149a291a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:40.305538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba771c-8f91-40e4-980f-ba21149a291a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:40.306427 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba771c-8f91-40e4-980f-ba21149a291a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:40.308026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba771c-8f91-40e4-980f-ba21149a291a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:40.320497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-c4ba771c-8f91-40e4-980f-ba21149a291a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 21:36:40.322336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 483/956] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:40.333597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba771c-8f91-40e4-980f-ba21149a291a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:40.352516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914daba-c245-44bb-af58-00691a3bfdb3 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:40.389148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb704cb-7cb0-4d8d-aaad-27a15f17a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:40.390031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb704cb-7cb0-4d8d-aaad-27a15f17a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:40.390204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb704cb-7cb0-4d8d-aaad-27a15f17a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:40.390414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb704cb-7cb0-4d8d-aaad-27a15f17a8e3 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:40.391232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb704cb-7cb0-4d8d-aaad-27a15f17a8e3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:40.391525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb704cb-7cb0-4d8d-aaad-27a15f17a8e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:40.393050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb704cb-7cb0-4d8d-aaad-27a15f17a8e3 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:40.439786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 474/957] 10.222.0.26 () {56 vars in 1101 bytes} [Mon Feb 28 21:36:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:40.456953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba771c-8f91-40e4-980f-ba21149a291a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:40.499307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36db526-0390-40bf-b38f-e1b7fb83734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:40.500005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36db526-0390-40bf-b38f-e1b7fb83734b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:40.500279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36db526-0390-40bf-b38f-e1b7fb83734b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:40.500548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36db526-0390-40bf-b38f-e1b7fb83734b None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:40.501274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36db526-0390-40bf-b38f-e1b7fb83734b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:40.501575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36db526-0390-40bf-b38f-e1b7fb83734b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:40.503115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36db526-0390-40bf-b38f-e1b7fb83734b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:40.510213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 484/958] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Feb 28 21:36:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:40.516098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb704cb-7cb0-4d8d-aaad-27a15f17a8e3 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:40.638413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb704cb-7cb0-4d8d-aaad-27a15f17a8e3 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:40.678502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a659c6-07b0-4d5b-9a03-be707770167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:40.679513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a659c6-07b0-4d5b-9a03-be707770167d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:40.680009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a659c6-07b0-4d5b-9a03-be707770167d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:40.680482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a659c6-07b0-4d5b-9a03-be707770167d None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:40.681417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a659c6-07b0-4d5b-9a03-be707770167d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:40.681921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a659c6-07b0-4d5b-9a03-be707770167d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:40.683608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a659c6-07b0-4d5b-9a03-be707770167d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:40.691403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 475/959] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Feb 28 21:36:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:40.696649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36db526-0390-40bf-b38f-e1b7fb83734b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:40.801952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36db526-0390-40bf-b38f-e1b7fb83734b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:40.841855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fecfb0-96ac-4526-961e-f5670098e215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:40.842845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fecfb0-96ac-4526-961e-f5670098e215 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:40.843295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fecfb0-96ac-4526-961e-f5670098e215 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:40.843737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fecfb0-96ac-4526-961e-f5670098e215 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:40.847120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fecfb0-96ac-4526-961e-f5670098e215 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:40.847120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fecfb0-96ac-4526-961e-f5670098e215 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:40.935122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 485/960] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Feb 28 21:36:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:41.313148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13061493-9eb2-411c-9573-671e31e7a1ed None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:41.313692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13061493-9eb2-411c-9573-671e31e7a1ed None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:41.313692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13061493-9eb2-411c-9573-671e31e7a1ed None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:41.316448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 476/961] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:41.322551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f0f9-44bd-4009-ba3a-99d24f83d32e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:41.322838 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f0f9-44bd-4009-ba3a-99d24f83d32e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:41.325446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f0f9-44bd-4009-ba3a-99d24f83d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:41.347788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-5548f0f9-44bd-4009-ba3a-99d24f83d32e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:41.349588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5548f0f9-44bd-4009-ba3a-99d24f83d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:41.419389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 486/962] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:41.441219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13061493-9eb2-411c-9573-671e31e7a1ed None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:41.536910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13061493-9eb2-411c-9573-671e31e7a1ed None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:41.568680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da844ad3-3fb9-441c-a710-4c429d5565e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:41.569475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da844ad3-3fb9-441c-a710-4c429d5565e8 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:41.569750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da844ad3-3fb9-441c-a710-4c429d5565e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:41.570045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da844ad3-3fb9-441c-a710-4c429d5565e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:41.570691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da844ad3-3fb9-441c-a710-4c429d5565e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:41.572031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da844ad3-3fb9-441c-a710-4c429d5565e8 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:41.583199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-da844ad3-3fb9-441c-a710-4c429d5565e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 21:36:41.584533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 477/963] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:41.590068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548f0f9-44bd-4009-ba3a-99d24f83d32e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:41.683645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548f0f9-44bd-4009-ba3a-99d24f83d32e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:41.716212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ef984-6f6d-4f57-bdd7-a635ae3152ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:41.717626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ef984-6f6d-4f57-bdd7-a635ae3152ec None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:41.718129 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ef984-6f6d-4f57-bdd7-a635ae3152ec None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:41.718595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ef984-6f6d-4f57-bdd7-a635ae3152ec None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:41.719509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ef984-6f6d-4f57-bdd7-a635ae3152ec None admin] RBAC: Adding query filter params (name=compute) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:41.720003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ef984-6f6d-4f57-bdd7-a635ae3152ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:41.721551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ef984-6f6d-4f57-bdd7-a635ae3152ec None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:41.727066 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 487/964] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:41.732363 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da844ad3-3fb9-441c-a710-4c429d5565e8 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:41.833034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da844ad3-3fb9-441c-a710-4c429d5565e8 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:41.867737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e209afd-d267-41b3-8d0e-f28c292f5eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:41.868503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e209afd-d267-41b3-8d0e-f28c292f5eab None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:41.868787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e209afd-d267-41b3-8d0e-f28c292f5eab None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:41.869051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e209afd-d267-41b3-8d0e-f28c292f5eab None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:41.869743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e209afd-d267-41b3-8d0e-f28c292f5eab None admin] RBAC: Adding query filter params (type=compute) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:41.870147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e209afd-d267-41b3-8d0e-f28c292f5eab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:41.871426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e209afd-d267-41b3-8d0e-f28c292f5eab None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:41.876027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 478/965] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:42.408044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ffb9d-a23c-4a6a-8c2a-fc97e2e77a7e None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:42.408383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ffb9d-a23c-4a6a-8c2a-fc97e2e77a7e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:42.408604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ffb9d-a23c-4a6a-8c2a-fc97e2e77a7e None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:42.410701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 488/966] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:42.415605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be463dd1-6633-4b15-9080-3e2deb5f6086 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:42.416027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be463dd1-6633-4b15-9080-3e2deb5f6086 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:42.416197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be463dd1-6633-4b15-9080-3e2deb5f6086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:42.433448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-be463dd1-6633-4b15-9080-3e2deb5f6086 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:42.434989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-be463dd1-6633-4b15-9080-3e2deb5f6086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:42.499350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 479/967] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:42.522803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ffb9d-a23c-4a6a-8c2a-fc97e2e77a7e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:42.622271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ffb9d-a23c-4a6a-8c2a-fc97e2e77a7e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:42.654867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23693118-c09b-4f23-bdb4-3646613f5d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:42.655733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23693118-c09b-4f23-bdb4-3646613f5d25 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:42.656015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23693118-c09b-4f23-bdb4-3646613f5d25 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:42.656336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23693118-c09b-4f23-bdb4-3646613f5d25 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:42.668618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23693118-c09b-4f23-bdb4-3646613f5d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:42.676729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-23693118-c09b-4f23-bdb4-3646613f5d25 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 21:36:42.682690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 489/968] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Feb 28 21:36:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:42.683927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be463dd1-6633-4b15-9080-3e2deb5f6086 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:42.777821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be463dd1-6633-4b15-9080-3e2deb5f6086 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:42.810252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5dcf8-3cf0-432c-a798-00eff266c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:42.810915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5dcf8-3cf0-432c-a798-00eff266c617 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:42.811193 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5dcf8-3cf0-432c-a798-00eff266c617 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:42.811463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5dcf8-3cf0-432c-a798-00eff266c617 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:42.812199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5dcf8-3cf0-432c-a798-00eff266c617 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:42.812500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5dcf8-3cf0-432c-a798-00eff266c617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:42.813865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5dcf8-3cf0-432c-a798-00eff266c617 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:42.830379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 480/969] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Feb 28 21:36:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:42.831594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23693118-c09b-4f23-bdb4-3646613f5d25 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:42.934407 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23693118-c09b-4f23-bdb4-3646613f5d25 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:42.969122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab02780-a4fc-4997-ba45-fefd328683f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:42.969920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab02780-a4fc-4997-ba45-fefd328683f0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:42.970228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab02780-a4fc-4997-ba45-fefd328683f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:42.970506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab02780-a4fc-4997-ba45-fefd328683f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:42.982427 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab02780-a4fc-4997-ba45-fefd328683f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:42.983901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab02780-a4fc-4997-ba45-fefd328683f0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:43.001302 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-aab02780-a4fc-4997-ba45-fefd328683f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:43.002809 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 490/970] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:43.008488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5dcf8-3cf0-432c-a798-00eff266c617 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:43.104913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5dcf8-3cf0-432c-a798-00eff266c617 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:43.136634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409862bb-0798-4ccd-a5ef-b10fd5f3e467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:43.137290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409862bb-0798-4ccd-a5ef-b10fd5f3e467 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:43.137831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409862bb-0798-4ccd-a5ef-b10fd5f3e467 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:43.137831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409862bb-0798-4ccd-a5ef-b10fd5f3e467 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:43.138546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409862bb-0798-4ccd-a5ef-b10fd5f3e467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:43.138852 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409862bb-0798-4ccd-a5ef-b10fd5f3e467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:43.140210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409862bb-0798-4ccd-a5ef-b10fd5f3e467 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:43.152523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 481/971] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:43.157844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab02780-a4fc-4997-ba45-fefd328683f0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:43.251950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab02780-a4fc-4997-ba45-fefd328683f0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:43.283111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad843b-0dbd-40c8-8852-6edd971bea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:43.283912 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad843b-0dbd-40c8-8852-6edd971bea3a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:43.284188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad843b-0dbd-40c8-8852-6edd971bea3a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:43.284454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad843b-0dbd-40c8-8852-6edd971bea3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:43.292971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad843b-0dbd-40c8-8852-6edd971bea3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:43.293621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062213a5-caa1-40af-8dc9-6109850134de None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:43.293905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062213a5-caa1-40af-8dc9-6109850134de None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:43.294202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062213a5-caa1-40af-8dc9-6109850134de None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:43.294459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad843b-0dbd-40c8-8852-6edd971bea3a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:43.296096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 482/972] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:43.301040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4695c-7449-463a-a535-ebc1bb737a14 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:43.301347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4695c-7449-463a-a535-ebc1bb737a14 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:43.301593 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4695c-7449-463a-a535-ebc1bb737a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:43.308738 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-88ad843b-0dbd-40c8-8852-6edd971bea3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 28 21:36:43.310075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 491/973] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Feb 28 21:36:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:43.315340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad843b-0dbd-40c8-8852-6edd971bea3a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:43.320079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-27a4695c-7449-463a-a535-ebc1bb737a14 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:43.321244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-27a4695c-7449-463a-a535-ebc1bb737a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:43.386030 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 483/974] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:43.408113 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4695c-7449-463a-a535-ebc1bb737a14 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:43.415102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad843b-0dbd-40c8-8852-6edd971bea3a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:43.448143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75e5d8-3505-44a4-b004-6817df2ba668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:43.448813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75e5d8-3505-44a4-b004-6817df2ba668 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:43.449090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75e5d8-3505-44a4-b004-6817df2ba668 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:43.449361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75e5d8-3505-44a4-b004-6817df2ba668 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:43.450210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75e5d8-3505-44a4-b004-6817df2ba668 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:43.450513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75e5d8-3505-44a4-b004-6817df2ba668 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:43.451922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75e5d8-3505-44a4-b004-6817df2ba668 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:43.469018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 492/975] 10.222.0.26 () {56 vars in 1149 bytes} [Mon Feb 28 21:36:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:43.474743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75e5d8-3505-44a4-b004-6817df2ba668 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:43.513729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4695c-7449-463a-a535-ebc1bb737a14 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:43.546089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092b4b4-78de-4823-acfa-d85dc3b6161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:43.546911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092b4b4-78de-4823-acfa-d85dc3b6161b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:43.547184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092b4b4-78de-4823-acfa-d85dc3b6161b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:43.547451 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092b4b4-78de-4823-acfa-d85dc3b6161b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:43.548089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092b4b4-78de-4823-acfa-d85dc3b6161b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:43.549439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092b4b4-78de-4823-acfa-d85dc3b6161b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:43.560857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-5092b4b4-78de-4823-acfa-d85dc3b6161b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 21:36:43.567599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 484/976] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:43.568962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092b4b4-78de-4823-acfa-d85dc3b6161b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:43.570863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75e5d8-3505-44a4-b004-6817df2ba668 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:43.604641 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b705bf-ac90-4c07-8628-4fb921770287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:43.605292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b705bf-ac90-4c07-8628-4fb921770287 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:43.605568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b705bf-ac90-4c07-8628-4fb921770287 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:43.605838 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b705bf-ac90-4c07-8628-4fb921770287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:43.667075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092b4b4-78de-4823-acfa-d85dc3b6161b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:43.674278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b705bf-ac90-4c07-8628-4fb921770287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:43.675740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b705bf-ac90-4c07-8628-4fb921770287 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:43.699052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc154e-2cf9-487b-ac07-208b4eb9f46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:43.699708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc154e-2cf9-487b-ac07-208b4eb9f46d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:43.699989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc154e-2cf9-487b-ac07-208b4eb9f46d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:43.700264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc154e-2cf9-487b-ac07-208b4eb9f46d None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:43.700968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc154e-2cf9-487b-ac07-208b4eb9f46d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:43.701274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc154e-2cf9-487b-ac07-208b4eb9f46d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:43.702657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc154e-2cf9-487b-ac07-208b4eb9f46d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:43.708315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 485/977] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Feb 28 21:36:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:43.713579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc154e-2cf9-487b-ac07-208b4eb9f46d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:43.776010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 493/978] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:43 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 21:36:43.776993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b705bf-ac90-4c07-8628-4fb921770287 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:43.810487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc154e-2cf9-487b-ac07-208b4eb9f46d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:43.847181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a3ab5-3f1c-4e02-9c93-111af3342f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:43.847933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a3ab5-3f1c-4e02-9c93-111af3342f7a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:43.851753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a3ab5-3f1c-4e02-9c93-111af3342f7a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:43.851753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a3ab5-3f1c-4e02-9c93-111af3342f7a None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:43.851753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a3ab5-3f1c-4e02-9c93-111af3342f7a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:43.851753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a3ab5-3f1c-4e02-9c93-111af3342f7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:43.851753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a3ab5-3f1c-4e02-9c93-111af3342f7a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:43.856322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 486/979] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Feb 28 21:36:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:43.861730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a3ab5-3f1c-4e02-9c93-111af3342f7a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:43.886120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b705bf-ac90-4c07-8628-4fb921770287 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:43.969129 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c72e38-9f9f-44fd-84b5-42259f8ac59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:43.970249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c72e38-9f9f-44fd-84b5-42259f8ac59f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:43.970704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c72e38-9f9f-44fd-84b5-42259f8ac59f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:43.971133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c72e38-9f9f-44fd-84b5-42259f8ac59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:43.981784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c72e38-9f9f-44fd-84b5-42259f8ac59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:43.983450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c72e38-9f9f-44fd-84b5-42259f8ac59f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:44.000724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-46c72e38-9f9f-44fd-84b5-42259f8ac59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:44.001215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a3ab5-3f1c-4e02-9c93-111af3342f7a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:44.001920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 494/980] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:44.008091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c72e38-9f9f-44fd-84b5-42259f8ac59f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:44.037579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee1a60-f287-4dd6-8dbf-5fc44a732206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:44.038189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee1a60-f287-4dd6-8dbf-5fc44a732206 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:44.038478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee1a60-f287-4dd6-8dbf-5fc44a732206 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:44.038751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee1a60-f287-4dd6-8dbf-5fc44a732206 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:44.039548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee1a60-f287-4dd6-8dbf-5fc44a732206 None admin] RBAC: Adding query filter params (interface=admin, service_id=45fa9b911258435f8778b0c8c8d66ecc, region_id=RegionOne) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:44.039860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee1a60-f287-4dd6-8dbf-5fc44a732206 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:44.041225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee1a60-f287-4dd6-8dbf-5fc44a732206 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:44.050665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 487/981] 10.222.0.26 () {56 vars in 1249 bytes} [Mon Feb 28 21:36:43 2022] GET /identity/v3/endpoints?service_id=45fa9b911258435f8778b0c8c8d66ecc&interface=admin®ion_id=RegionOne => generated 193 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:44.051609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee1a60-f287-4dd6-8dbf-5fc44a732206 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:44.106220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c72e38-9f9f-44fd-84b5-42259f8ac59f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:44.139450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ee36c-3152-4f53-a85a-2e3fa297077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:44.140114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ee36c-3152-4f53-a85a-2e3fa297077b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:44.140392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ee36c-3152-4f53-a85a-2e3fa297077b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:44.140663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ee36c-3152-4f53-a85a-2e3fa297077b None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:44.141376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ee36c-3152-4f53-a85a-2e3fa297077b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:44.141675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ee36c-3152-4f53-a85a-2e3fa297077b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:44.143044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ee36c-3152-4f53-a85a-2e3fa297077b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:44.149899 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee1a60-f287-4dd6-8dbf-5fc44a732206 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:44.154257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 495/982] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:44.159334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ee36c-3152-4f53-a85a-2e3fa297077b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:44.183164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfe4a9-b191-4911-9311-548ee624053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:44.183828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfe4a9-b191-4911-9311-548ee624053d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:44.184106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfe4a9-b191-4911-9311-548ee624053d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:44.184379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfe4a9-b191-4911-9311-548ee624053d None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:44.185052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfe4a9-b191-4911-9311-548ee624053d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:44.186438 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfe4a9-b191-4911-9311-548ee624053d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:44.206018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 488/983] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Feb 28 21:36:44 2022] GET /identity/v3/services => generated 1497 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:36:44.206018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506f0a-21c6-4291-8ffe-ff6cf54012fd None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:44.206018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506f0a-21c6-4291-8ffe-ff6cf54012fd None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:44.206018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506f0a-21c6-4291-8ffe-ff6cf54012fd None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:44.206018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 489/984] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:44.206018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2494fd4-8f03-476c-9f8e-63fea95d22df None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:44.206018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2494fd4-8f03-476c-9f8e-63fea95d22df None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:44.206655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2494fd4-8f03-476c-9f8e-63fea95d22df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:44.219890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-c2494fd4-8f03-476c-9f8e-63fea95d22df None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:44.221141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c2494fd4-8f03-476c-9f8e-63fea95d22df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:44.261676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ee36c-3152-4f53-a85a-2e3fa297077b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:44.293255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 490/985] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:44.301200 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f7c7-d15a-494a-a8b0-579503cad3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:44.302032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f7c7-d15a-494a-a8b0-579503cad3e4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:44.302364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f7c7-d15a-494a-a8b0-579503cad3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:44.302637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f7c7-d15a-494a-a8b0-579503cad3e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:44.310227 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f7c7-d15a-494a-a8b0-579503cad3e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:44.311758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f7c7-d15a-494a-a8b0-579503cad3e4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:44.315623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2494fd4-8f03-476c-9f8e-63fea95d22df None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:44.327060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-16e3f7c7-d15a-494a-a8b0-579503cad3e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:44.328637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 496/986] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:44.334826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f7c7-d15a-494a-a8b0-579503cad3e4 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:44.433510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2494fd4-8f03-476c-9f8e-63fea95d22df None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:44.434281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f7c7-d15a-494a-a8b0-579503cad3e4 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:44.466768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5769763-b0f2-400b-989d-f35209c2e9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:44.467139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637adf3a-d08b-4d06-b54e-2eb01633f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:44.467804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637adf3a-d08b-4d06-b54e-2eb01633f581 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:44.468019 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5769763-b0f2-400b-989d-f35209c2e9a1 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:44.468137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637adf3a-d08b-4d06-b54e-2eb01633f581 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:44.468345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637adf3a-d08b-4d06-b54e-2eb01633f581 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:44.468697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5769763-b0f2-400b-989d-f35209c2e9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:44.469118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5769763-b0f2-400b-989d-f35209c2e9a1 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:44.469225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637adf3a-d08b-4d06-b54e-2eb01633f581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:44.469532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637adf3a-d08b-4d06-b54e-2eb01633f581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:44.470242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5769763-b0f2-400b-989d-f35209c2e9a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:44.471161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637adf3a-d08b-4d06-b54e-2eb01633f581 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:44.471910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5769763-b0f2-400b-989d-f35209c2e9a1 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:44.483416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 497/987] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:44.489813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637adf3a-d08b-4d06-b54e-2eb01633f581 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:44.558104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 491/988] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:36:44 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:36:44.590296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637adf3a-d08b-4d06-b54e-2eb01633f581 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:44.633206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec47f-a9cd-49a0-8fdb-d2035713f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:44.633875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec47f-a9cd-49a0-8fdb-d2035713f297 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:44.634179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec47f-a9cd-49a0-8fdb-d2035713f297 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:44.634448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec47f-a9cd-49a0-8fdb-d2035713f297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:44.635302 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec47f-a9cd-49a0-8fdb-d2035713f297 None admin] RBAC: Adding query filter params (role.id=27d9513a3f8d4f59a5005e708bbbf4b5, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=3e0f83cdc2d54ced991c979f9de554a0) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:44.635613 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec47f-a9cd-49a0-8fdb-d2035713f297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:44.637074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec47f-a9cd-49a0-8fdb-d2035713f297 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:44.650029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 498/989] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:44 2022] GET /identity/v3/role_assignments?user.id=3e0f83cdc2d54ced991c979f9de554a0&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=27d9513a3f8d4f59a5005e708bbbf4b5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:46.492433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544749-f9f5-4ff5-ac0e-41ff25be10ba None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:46.492958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544749-f9f5-4ff5-ac0e-41ff25be10ba None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:46.492958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544749-f9f5-4ff5-ac0e-41ff25be10ba None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:46.494824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 492/990] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:46.500084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d81a-388e-497a-ba58-443bc2cc290d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:46.500532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d81a-388e-497a-ba58-443bc2cc290d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:46.500640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d81a-388e-497a-ba58-443bc2cc290d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:46.518678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0097d81a-388e-497a-ba58-443bc2cc290d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:46.519953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0097d81a-388e-497a-ba58-443bc2cc290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:46.588416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 499/991] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:46.611932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc544749-f9f5-4ff5-ac0e-41ff25be10ba None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:46.714995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc544749-f9f5-4ff5-ac0e-41ff25be10ba None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:46.747299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000d8d6-ad4d-44e6-a4c4-255b4ee22e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:46.748038 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d8d6-ad4d-44e6-a4c4-255b4ee22e06 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:46.748320 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d8d6-ad4d-44e6-a4c4-255b4ee22e06 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:46.748596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d8d6-ad4d-44e6-a4c4-255b4ee22e06 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:46.749252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000d8d6-ad4d-44e6-a4c4-255b4ee22e06 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:46.750646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000d8d6-ad4d-44e6-a4c4-255b4ee22e06 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:46.762045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-d000d8d6-ad4d-44e6-a4c4-255b4ee22e06 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 28 21:36:46.763380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 493/992] 10.222.0.26 () {56 vars in 1126 bytes} [Mon Feb 28 21:36:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:46.769287 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097d81a-388e-497a-ba58-443bc2cc290d None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:46.877971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097d81a-388e-497a-ba58-443bc2cc290d None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:46.912940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b965eba-cee8-4c8b-af6f-44cda321cede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:46.913607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b965eba-cee8-4c8b-af6f-44cda321cede None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:46.913889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b965eba-cee8-4c8b-af6f-44cda321cede None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:46.914196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b965eba-cee8-4c8b-af6f-44cda321cede None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:46.914905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b965eba-cee8-4c8b-af6f-44cda321cede None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:46.915210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b965eba-cee8-4c8b-af6f-44cda321cede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:46.916590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b965eba-cee8-4c8b-af6f-44cda321cede None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:46.921521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 500/993] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Feb 28 21:36:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:46.927682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000d8d6-ad4d-44e6-a4c4-255b4ee22e06 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:46.958439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e354c-53e4-492f-bcc2-527bbeab2f3b None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:46.958730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e354c-53e4-492f-bcc2-527bbeab2f3b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:46.959014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e354c-53e4-492f-bcc2-527bbeab2f3b None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:46.960833 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 501/994] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:46.966281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c97b72-04de-46f6-866d-3fcc85fa3b72 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:46.966567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c97b72-04de-46f6-866d-3fcc85fa3b72 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:46.966840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c97b72-04de-46f6-866d-3fcc85fa3b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:46.986386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-20c97b72-04de-46f6-866d-3fcc85fa3b72 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:46.988532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-20c97b72-04de-46f6-866d-3fcc85fa3b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:47.033903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000d8d6-ad4d-44e6-a4c4-255b4ee22e06 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:47.052506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 502/995] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:47.053956 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590fec5-aba7-492e-a233-d670f86fb9d5 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.054274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590fec5-aba7-492e-a233-d670f86fb9d5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.054547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590fec5-aba7-492e-a233-d670f86fb9d5 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.056340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 503/996] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:47.061494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60763f-0758-4159-a6d4-122c20242e8a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.061774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60763f-0758-4159-a6d4-122c20242e8a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.062079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60763f-0758-4159-a6d4-122c20242e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.067549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ec8b4-f930-45df-8955-731e6eb0cc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:47.068215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ec8b4-f930-45df-8955-731e6eb0cc01 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.068492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ec8b4-f930-45df-8955-731e6eb0cc01 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.068768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ec8b4-f930-45df-8955-731e6eb0cc01 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.069474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ec8b4-f930-45df-8955-731e6eb0cc01 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:47.069776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ec8b4-f930-45df-8955-731e6eb0cc01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:47.071182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ec8b4-f930-45df-8955-731e6eb0cc01 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:47.076046 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 494/997] 10.222.0.26 () {56 vars in 1122 bytes} [Mon Feb 28 21:36:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:47.076828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ec8b4-f930-45df-8955-731e6eb0cc01 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:47.082664 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-7a60763f-0758-4159-a6d4-122c20242e8a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:47.083890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7a60763f-0758-4159-a6d4-122c20242e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:47.148500 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 504/998] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:47.149306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60763f-0758-4159-a6d4-122c20242e8a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:47.171010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ec8b4-f930-45df-8955-731e6eb0cc01 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:47.203355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaa441-6e94-43b5-b6e6-a96b21393d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:47.204140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaa441-6e94-43b5-b6e6-a96b21393d06 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.204415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaa441-6e94-43b5-b6e6-a96b21393d06 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.204684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaa441-6e94-43b5-b6e6-a96b21393d06 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.205331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaa441-6e94-43b5-b6e6-a96b21393d06 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:47.206721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaa441-6e94-43b5-b6e6-a96b21393d06 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:47.217546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-bcbaa441-6e94-43b5-b6e6-a96b21393d06 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 21:36:47.218751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 495/999] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:47.219503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaa441-6e94-43b5-b6e6-a96b21393d06 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:47.243316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60763f-0758-4159-a6d4-122c20242e8a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:47.274865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ea288-a352-492f-a95c-b5083539a138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:47.275505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ea288-a352-492f-a95c-b5083539a138 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.275782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ea288-a352-492f-a95c-b5083539a138 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.276050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ea288-a352-492f-a95c-b5083539a138 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.276770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ea288-a352-492f-a95c-b5083539a138 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:47.278140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ea288-a352-492f-a95c-b5083539a138 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:47.317949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaa441-6e94-43b5-b6e6-a96b21393d06 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:47.343992 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 505/1000] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Feb 28 21:36:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:47.351856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ea288-a352-492f-a95c-b5083539a138 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:47.356074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f9378-07a6-464b-ab9f-29d41f9ccde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:47.356885 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f9378-07a6-464b-ab9f-29d41f9ccde8 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.357159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f9378-07a6-464b-ab9f-29d41f9ccde8 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.357430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f9378-07a6-464b-ab9f-29d41f9ccde8 None admin] PATH_INFO: `/v3/services/image` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.358125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f9378-07a6-464b-ab9f-29d41f9ccde8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:47.359592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f9378-07a6-464b-ab9f-29d41f9ccde8 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:47.372282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-517f9378-07a6-464b-ab9f-29d41f9ccde8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 21:36:47.378197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 496/1001] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Feb 28 21:36:47 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:47.380103 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f9378-07a6-464b-ab9f-29d41f9ccde8 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:47.459455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ea288-a352-492f-a95c-b5083539a138 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:47.483676 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f9378-07a6-464b-ab9f-29d41f9ccde8 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:47.494190 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaf678-c472-4dd6-8981-e2071e03b14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:47.494872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaf678-c472-4dd6-8981-e2071e03b14e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.495152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaf678-c472-4dd6-8981-e2071e03b14e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.495416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaf678-c472-4dd6-8981-e2071e03b14e None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.496139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaf678-c472-4dd6-8981-e2071e03b14e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:47.496437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaf678-c472-4dd6-8981-e2071e03b14e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:47.497803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaf678-c472-4dd6-8981-e2071e03b14e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:47.503058 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 506/1002] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:47.509305 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaf678-c472-4dd6-8981-e2071e03b14e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:47.521621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db32d3c-a65a-4ce3-a0fc-8bf20a5c723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:47.522323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db32d3c-a65a-4ce3-a0fc-8bf20a5c723a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.522603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db32d3c-a65a-4ce3-a0fc-8bf20a5c723a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.522872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db32d3c-a65a-4ce3-a0fc-8bf20a5c723a None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.523576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db32d3c-a65a-4ce3-a0fc-8bf20a5c723a None admin] RBAC: Adding query filter params (name=image) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:47.523875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db32d3c-a65a-4ce3-a0fc-8bf20a5c723a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:47.525291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db32d3c-a65a-4ce3-a0fc-8bf20a5c723a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:47.530520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 497/1003] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:47.536524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db32d3c-a65a-4ce3-a0fc-8bf20a5c723a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:47.613650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaf678-c472-4dd6-8981-e2071e03b14e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:47.633129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db32d3c-a65a-4ce3-a0fc-8bf20a5c723a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:47.648225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25822675-40d4-4b65-9bb7-5751b9962a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:47.649277 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25822675-40d4-4b65-9bb7-5751b9962a93 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.649960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25822675-40d4-4b65-9bb7-5751b9962a93 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.650427 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25822675-40d4-4b65-9bb7-5751b9962a93 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.651314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25822675-40d4-4b65-9bb7-5751b9962a93 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:47.651768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25822675-40d4-4b65-9bb7-5751b9962a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:47.654036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25822675-40d4-4b65-9bb7-5751b9962a93 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:47.660869 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 507/1004] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:47.666073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef51949-46be-4c31-9f98-12f1f4e46c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:47.666211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25822675-40d4-4b65-9bb7-5751b9962a93 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:47.666744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51949-46be-4c31-9f98-12f1f4e46c4b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.667030 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51949-46be-4c31-9f98-12f1f4e46c4b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.667307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51949-46be-4c31-9f98-12f1f4e46c4b None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.668013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef51949-46be-4c31-9f98-12f1f4e46c4b None admin] RBAC: Adding query filter params (type=image) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:47.668319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef51949-46be-4c31-9f98-12f1f4e46c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:47.669673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef51949-46be-4c31-9f98-12f1f4e46c4b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:47.674203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 498/1005] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:47.774119 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25822675-40d4-4b65-9bb7-5751b9962a93 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:47.809343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68fe07-4148-46bb-a817-52537599b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:47.810049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68fe07-4148-46bb-a817-52537599b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.810336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68fe07-4148-46bb-a817-52537599b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.810614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68fe07-4148-46bb-a817-52537599b0c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.811411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68fe07-4148-46bb-a817-52537599b0c5 None admin] RBAC: Adding query filter params (interface=public, service_id=b5223beb06bd4363a1d891488c1e59ab, region_id=RegionOne) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:47.811723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68fe07-4148-46bb-a817-52537599b0c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:47.813102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68fe07-4148-46bb-a817-52537599b0c5 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:47.824713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 508/1006] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Feb 28 21:36:47 2022] GET /identity/v3/endpoints?service_id=b5223beb06bd4363a1d891488c1e59ab&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:47.825967 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef51949-46be-4c31-9f98-12f1f4e46c4b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:47.930110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef51949-46be-4c31-9f98-12f1f4e46c4b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:47.962599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c4f5b-366d-4bbe-81cb-fbf353942fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:47.963253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4f5b-366d-4bbe-81cb-fbf353942fee None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:47.963548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4f5b-366d-4bbe-81cb-fbf353942fee None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:47.963847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c4f5b-366d-4bbe-81cb-fbf353942fee None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:47.964519 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c4f5b-366d-4bbe-81cb-fbf353942fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:47.965863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c4f5b-366d-4bbe-81cb-fbf353942fee None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:47.978033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 499/1007] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Feb 28 21:36:47 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:36:49.672150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bedbbc-8bae-4d1b-a2be-23afa6327694 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:49.672732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bedbbc-8bae-4d1b-a2be-23afa6327694 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:49.672732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bedbbc-8bae-4d1b-a2be-23afa6327694 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:49.674616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 509/1008] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:49.680335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42723c64-08b1-4dd3-bf82-d53c6e5bef59 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:49.680810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42723c64-08b1-4dd3-bf82-d53c6e5bef59 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:49.680988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42723c64-08b1-4dd3-bf82-d53c6e5bef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:49.700381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-42723c64-08b1-4dd3-bf82-d53c6e5bef59 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:49.701553 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-42723c64-08b1-4dd3-bf82-d53c6e5bef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:49.766730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 500/1009] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:49.789641 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bedbbc-8bae-4d1b-a2be-23afa6327694 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:49.898430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bedbbc-8bae-4d1b-a2be-23afa6327694 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:49.930692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d84398-deee-4fc7-9701-ffffbe39feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:49.931413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d84398-deee-4fc7-9701-ffffbe39feef None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:49.931694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d84398-deee-4fc7-9701-ffffbe39feef None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:49.931967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d84398-deee-4fc7-9701-ffffbe39feef None admin] PATH_INFO: `/v3/domains/default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:49.933138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d84398-deee-4fc7-9701-ffffbe39feef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:49.934618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d84398-deee-4fc7-9701-ffffbe39feef None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:49.936458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 510/1010] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:49.942291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42723c64-08b1-4dd3-bf82-d53c6e5bef59 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:50.000758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee489d4-6386-476f-8172-ade97bf88108 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:50.001046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee489d4-6386-476f-8172-ade97bf88108 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:50.001526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee489d4-6386-476f-8172-ade97bf88108 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:50.005296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 511/1011] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:50.009964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd2281-25fd-435a-a20e-1c815c1887ef None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:50.010447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd2281-25fd-435a-a20e-1c815c1887ef None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:50.010896 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd2281-25fd-435a-a20e-1c815c1887ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:50.028279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4ecd2281-25fd-435a-a20e-1c815c1887ef None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:50.029733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4ecd2281-25fd-435a-a20e-1c815c1887ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:50.041878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42723c64-08b1-4dd3-bf82-d53c6e5bef59 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:50.075827 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa7458-24d4-45d6-aa87-b07dff7bbfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:50.076490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7458-24d4-45d6-aa87-b07dff7bbfba None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:50.076766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7458-24d4-45d6-aa87-b07dff7bbfba None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:50.077035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7458-24d4-45d6-aa87-b07dff7bbfba None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:50.077745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa7458-24d4-45d6-aa87-b07dff7bbfba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:50.079199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa7458-24d4-45d6-aa87-b07dff7bbfba None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:50.098842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 512/1012] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:50.121539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd2281-25fd-435a-a20e-1c815c1887ef None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:50.169010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 501/1013] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:36:49 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:36:50.224908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd2281-25fd-435a-a20e-1c815c1887ef None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:50.261901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6843744-06c4-42a8-9425-1c5d019f459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:50.262623 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6843744-06c4-42a8-9425-1c5d019f459a None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:50.262903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6843744-06c4-42a8-9425-1c5d019f459a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:50.263177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6843744-06c4-42a8-9425-1c5d019f459a None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:50.263914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6843744-06c4-42a8-9425-1c5d019f459a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:50.265301 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6843744-06c4-42a8-9425-1c5d019f459a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:50.327844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 513/1014] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:36:50 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:36:50.335000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588f280-e318-4214-ba99-ad1984a93d09 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:50.335533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588f280-e318-4214-ba99-ad1984a93d09 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:50.335634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588f280-e318-4214-ba99-ad1984a93d09 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:50.337476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 502/1015] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:50.343750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b84ba8-7cac-4bab-a9ed-4bc90a3b97af None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:50.344035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b84ba8-7cac-4bab-a9ed-4bc90a3b97af None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:50.344311 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b84ba8-7cac-4bab-a9ed-4bc90a3b97af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:50.365068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-12b84ba8-7cac-4bab-a9ed-4bc90a3b97af None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:50.369842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-12b84ba8-7cac-4bab-a9ed-4bc90a3b97af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:50.448874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 514/1016] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:50 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:50.473587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588f280-e318-4214-ba99-ad1984a93d09 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:50.577111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588f280-e318-4214-ba99-ad1984a93d09 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:50.610623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a77889-0892-4d5b-99e3-d68eac762e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:50.611421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a77889-0892-4d5b-99e3-d68eac762e6f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:50.611707 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a77889-0892-4d5b-99e3-d68eac762e6f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:50.612040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a77889-0892-4d5b-99e3-d68eac762e6f None admin] PATH_INFO: `/v3/services/compute` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:50.612699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a77889-0892-4d5b-99e3-d68eac762e6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:50.614196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a77889-0892-4d5b-99e3-d68eac762e6f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:50.625021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-a7a77889-0892-4d5b-99e3-d68eac762e6f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 28 21:36:50.626378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 503/1017] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:50.633447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b84ba8-7cac-4bab-a9ed-4bc90a3b97af None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:50.734272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b84ba8-7cac-4bab-a9ed-4bc90a3b97af None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:50.766876 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e81f8-e3e4-4cdf-be48-d81586a8c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:50.767539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e81f8-e3e4-4cdf-be48-d81586a8c5ac None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:50.767819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e81f8-e3e4-4cdf-be48-d81586a8c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:50.768089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e81f8-e3e4-4cdf-be48-d81586a8c5ac None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:50.768801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e81f8-e3e4-4cdf-be48-d81586a8c5ac None admin] RBAC: Adding query filter params (name=compute) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:50.769103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e81f8-e3e4-4cdf-be48-d81586a8c5ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:50.771161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e81f8-e3e4-4cdf-be48-d81586a8c5ac None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:50.780638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 515/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:50.781569 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a77889-0892-4d5b-99e3-d68eac762e6f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:50.878304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a77889-0892-4d5b-99e3-d68eac762e6f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:50.912360 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614fbb3-c868-47b9-9c52-24bb7924e1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:50.913028 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614fbb3-c868-47b9-9c52-24bb7924e1b6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:50.913312 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614fbb3-c868-47b9-9c52-24bb7924e1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:50.913630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614fbb3-c868-47b9-9c52-24bb7924e1b6 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:50.914359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614fbb3-c868-47b9-9c52-24bb7924e1b6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:50.914668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614fbb3-c868-47b9-9c52-24bb7924e1b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:50.916022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614fbb3-c868-47b9-9c52-24bb7924e1b6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:50.925528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 504/1019] 10.222.0.26 () {56 vars in 1112 bytes} [Mon Feb 28 21:36:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:50.926558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e81f8-e3e4-4cdf-be48-d81586a8c5ac None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:51.023488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e81f8-e3e4-4cdf-be48-d81586a8c5ac None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:51.058191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cb94e-ed97-427d-bbf3-e293f7cf1e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:51.058854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cb94e-ed97-427d-bbf3-e293f7cf1e02 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:51.059141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cb94e-ed97-427d-bbf3-e293f7cf1e02 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:51.059424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cb94e-ed97-427d-bbf3-e293f7cf1e02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:51.060169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cb94e-ed97-427d-bbf3-e293f7cf1e02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:51.061532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cb94e-ed97-427d-bbf3-e293f7cf1e02 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:51.132399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 516/1020] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Feb 28 21:36:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:36:52.532724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9705c-a0f9-4986-93c3-8f2a72d59128 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:52.533270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9705c-a0f9-4986-93c3-8f2a72d59128 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:52.533270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9705c-a0f9-4986-93c3-8f2a72d59128 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:52.535183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 505/1021] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:52.540726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40647fb8-2bce-4145-8ae6-502bf12c2e2b None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:52.541114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40647fb8-2bce-4145-8ae6-502bf12c2e2b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:52.541265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40647fb8-2bce-4145-8ae6-502bf12c2e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:52.557726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-40647fb8-2bce-4145-8ae6-502bf12c2e2b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:52.558935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-40647fb8-2bce-4145-8ae6-502bf12c2e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:52.628022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 517/1022] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:52.653074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9705c-a0f9-4986-93c3-8f2a72d59128 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:52.666995 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e879f-365a-41f7-958b-7121c1052d65 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:52.667296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e879f-365a-41f7-958b-7121c1052d65 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:52.667552 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e879f-365a-41f7-958b-7121c1052d65 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:52.669576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 518/1023] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:52.674212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69001fd1-9831-48fd-a06e-cd44bb1e4a49 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:52.674497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69001fd1-9831-48fd-a06e-cd44bb1e4a49 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:52.674770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69001fd1-9831-48fd-a06e-cd44bb1e4a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:52.692842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-69001fd1-9831-48fd-a06e-cd44bb1e4a49 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:52.694045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-69001fd1-9831-48fd-a06e-cd44bb1e4a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:52.755363 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9705c-a0f9-4986-93c3-8f2a72d59128 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:52.762874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 519/1024] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:52.787654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb44bc-f1d5-45b0-a046-94120ebaed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:52.788390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb44bc-f1d5-45b0-a046-94120ebaed4d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:52.788664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb44bc-f1d5-45b0-a046-94120ebaed4d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:52.788934 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb44bc-f1d5-45b0-a046-94120ebaed4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:52.790406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb44bc-f1d5-45b0-a046-94120ebaed4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:52.791692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb44bc-f1d5-45b0-a046-94120ebaed4d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:52.791823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69001fd1-9831-48fd-a06e-cd44bb1e4a49 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:52.793437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 506/1025] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:52.798952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb44bc-f1d5-45b0-a046-94120ebaed4d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:52.899028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69001fd1-9831-48fd-a06e-cd44bb1e4a49 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:52.899988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb44bc-f1d5-45b0-a046-94120ebaed4d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:52.933104 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81205ff-7316-4669-8bb0-a70d567416fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:52.933324 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcc363-0aa9-4872-b365-03a158770560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:52.933775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc363-0aa9-4872-b365-03a158770560 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:52.933884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81205ff-7316-4669-8bb0-a70d567416fb None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:52.934086 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc363-0aa9-4872-b365-03a158770560 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:52.934198 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81205ff-7316-4669-8bb0-a70d567416fb None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:52.934417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc363-0aa9-4872-b365-03a158770560 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:52.934520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81205ff-7316-4669-8bb0-a70d567416fb None admin] PATH_INFO: `/v3/services/image` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:52.935061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcc363-0aa9-4872-b365-03a158770560 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:52.935163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81205ff-7316-4669-8bb0-a70d567416fb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:52.936432 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81205ff-7316-4669-8bb0-a70d567416fb None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:52.936525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcc363-0aa9-4872-b365-03a158770560 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:52.948413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-d81205ff-7316-4669-8bb0-a70d567416fb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 21:36:52.949613 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 520/1026] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Feb 28 21:36:52 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:52.955579 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81205ff-7316-4669-8bb0-a70d567416fb None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:53.036253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 507/1027] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:36:52 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:36:53.054626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81205ff-7316-4669-8bb0-a70d567416fb None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:53.090744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae541c-b9e7-4277-85aa-a3c4832909d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:53.091418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae541c-b9e7-4277-85aa-a3c4832909d3 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:53.091701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae541c-b9e7-4277-85aa-a3c4832909d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:53.091975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae541c-b9e7-4277-85aa-a3c4832909d3 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:53.092691 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae541c-b9e7-4277-85aa-a3c4832909d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:53.092993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae541c-b9e7-4277-85aa-a3c4832909d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:53.094433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae541c-b9e7-4277-85aa-a3c4832909d3 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:53.100659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 521/1028] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:53.106682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcc363-0aa9-4872-b365-03a158770560 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:53.213606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcc363-0aa9-4872-b365-03a158770560 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:53.251044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45f435-53a2-4ec4-b0da-ecd615ae65aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:53.251859 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f435-53a2-4ec4-b0da-ecd615ae65aa None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:53.252040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f435-53a2-4ec4-b0da-ecd615ae65aa None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:53.252587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f435-53a2-4ec4-b0da-ecd615ae65aa None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:53.252971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45f435-53a2-4ec4-b0da-ecd615ae65aa None admin] RBAC: Adding query filter params (type=image) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:53.253274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45f435-53a2-4ec4-b0da-ecd615ae65aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:53.254881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45f435-53a2-4ec4-b0da-ecd615ae65aa None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:53.260490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 508/1029] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:53.266152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae541c-b9e7-4277-85aa-a3c4832909d3 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:53.366048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae541c-b9e7-4277-85aa-a3c4832909d3 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:53.398182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf978-30df-4ab1-b3c5-0e404afbddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:53.398837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf978-30df-4ab1-b3c5-0e404afbddca None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:53.399123 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf978-30df-4ab1-b3c5-0e404afbddca None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:53.399390 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf978-30df-4ab1-b3c5-0e404afbddca None admin] PATH_INFO: `/v3/endpoints` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:53.400160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf978-30df-4ab1-b3c5-0e404afbddca None admin] RBAC: Adding query filter params (interface=public, service_id=473317308a5e4da5837af3870d3def72, region_id=RegionOne) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:53.400462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf978-30df-4ab1-b3c5-0e404afbddca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:53.401867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf978-30df-4ab1-b3c5-0e404afbddca None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:53.407047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 522/1030] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Feb 28 21:36:53 2022] GET /identity/v3/endpoints?service_id=473317308a5e4da5837af3870d3def72&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:53.413271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45f435-53a2-4ec4-b0da-ecd615ae65aa None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:53.510379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45f435-53a2-4ec4-b0da-ecd615ae65aa None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:53.542156 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9cccd-810f-4b8a-9195-5a9398b69cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:53.542806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9cccd-810f-4b8a-9195-5a9398b69cc6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:53.543078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9cccd-810f-4b8a-9195-5a9398b69cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:53.543351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9cccd-810f-4b8a-9195-5a9398b69cc6 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:53.544020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9cccd-810f-4b8a-9195-5a9398b69cc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:53.545384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9cccd-810f-4b8a-9195-5a9398b69cc6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:53.552513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 509/1031] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Feb 28 21:36:53 2022] GET /identity/v3/services => generated 1957 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:36:53.569902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f68c9-d7d6-4186-8890-1324cf6c8256 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:53.570493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f68c9-d7d6-4186-8890-1324cf6c8256 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:53.570493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f68c9-d7d6-4186-8890-1324cf6c8256 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:53.572532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 523/1032] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:53.578380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f073eaf-f2a2-49f1-9682-bd9b1e513a4b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:53.578685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f073eaf-f2a2-49f1-9682-bd9b1e513a4b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:53.578939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f073eaf-f2a2-49f1-9682-bd9b1e513a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:53.597801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8f073eaf-f2a2-49f1-9682-bd9b1e513a4b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:53.599253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8f073eaf-f2a2-49f1-9682-bd9b1e513a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:53.670108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 510/1033] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:53.693822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f68c9-d7d6-4186-8890-1324cf6c8256 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:53.797208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f68c9-d7d6-4186-8890-1324cf6c8256 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:53.830556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bef89f-b507-4c95-810e-dab638b24bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:53.832495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef89f-b507-4c95-810e-dab638b24bad None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:53.832996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef89f-b507-4c95-810e-dab638b24bad None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:53.833451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef89f-b507-4c95-810e-dab638b24bad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:53.845382 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bef89f-b507-4c95-810e-dab638b24bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:53.853569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a9bef89f-b507-4c95-810e-dab638b24bad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 21:36:53.858051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 524/1034] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Feb 28 21:36:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:53.860917 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f073eaf-f2a2-49f1-9682-bd9b1e513a4b None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:53.960488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f073eaf-f2a2-49f1-9682-bd9b1e513a4b None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:53.992437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bf627-d341-48a5-9e20-1373d94309ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:53.993101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bf627-d341-48a5-9e20-1373d94309ba None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:53.993433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bf627-d341-48a5-9e20-1373d94309ba None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:53.993709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bf627-d341-48a5-9e20-1373d94309ba None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:53.994481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bf627-d341-48a5-9e20-1373d94309ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:53.994784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bf627-d341-48a5-9e20-1373d94309ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:53.996136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bf627-d341-48a5-9e20-1373d94309ba None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:54.004926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 511/1035] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Feb 28 21:36:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:54.010559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bef89f-b507-4c95-810e-dab638b24bad None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:54.105709 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bef89f-b507-4c95-810e-dab638b24bad None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:54.138424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43a4fa-0a5c-4021-b13b-8673f78ac390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:54.139208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43a4fa-0a5c-4021-b13b-8673f78ac390 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:54.139488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43a4fa-0a5c-4021-b13b-8673f78ac390 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:54.139757 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43a4fa-0a5c-4021-b13b-8673f78ac390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:54.150299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43a4fa-0a5c-4021-b13b-8673f78ac390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:54.151748 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43a4fa-0a5c-4021-b13b-8673f78ac390 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:54.169360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-4a43a4fa-0a5c-4021-b13b-8673f78ac390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:54.170743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 525/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:54.176340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bf627-d341-48a5-9e20-1373d94309ba None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:54.279844 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bf627-d341-48a5-9e20-1373d94309ba None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:54.312151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442028-6e83-45ce-b75b-80df45402a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:54.312817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442028-6e83-45ce-b75b-80df45402a5e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:54.313096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442028-6e83-45ce-b75b-80df45402a5e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:54.313368 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442028-6e83-45ce-b75b-80df45402a5e None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:54.314121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442028-6e83-45ce-b75b-80df45402a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:54.314430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442028-6e83-45ce-b75b-80df45402a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:54.315833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442028-6e83-45ce-b75b-80df45402a5e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:54.327580 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 512/1037] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:54.333529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43a4fa-0a5c-4021-b13b-8673f78ac390 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:54.429356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43a4fa-0a5c-4021-b13b-8673f78ac390 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:54.461276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42a311-f2e0-46a9-8364-9f0ed28b9612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:54.462077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a311-f2e0-46a9-8364-9f0ed28b9612 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:54.462354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a311-f2e0-46a9-8364-9f0ed28b9612 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:54.462622 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a311-f2e0-46a9-8364-9f0ed28b9612 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:54.469790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42a311-f2e0-46a9-8364-9f0ed28b9612 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:54.471241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42a311-f2e0-46a9-8364-9f0ed28b9612 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:54.484697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-9b42a311-f2e0-46a9-8364-9f0ed28b9612 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 21:36:54.485835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 526/1038] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Feb 28 21:36:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:54.491804 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442028-6e83-45ce-b75b-80df45402a5e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:54.587306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442028-6e83-45ce-b75b-80df45402a5e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:54.619413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff96cb-5db9-45a4-9fd8-a973fa413526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:54.620082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff96cb-5db9-45a4-9fd8-a973fa413526 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:54.620361 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff96cb-5db9-45a4-9fd8-a973fa413526 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:54.620631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff96cb-5db9-45a4-9fd8-a973fa413526 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:54.621450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff96cb-5db9-45a4-9fd8-a973fa413526 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:54.621758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff96cb-5db9-45a4-9fd8-a973fa413526 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:54.623213 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff96cb-5db9-45a4-9fd8-a973fa413526 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:54.645727 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 513/1039] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Feb 28 21:36:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:54.647091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42a311-f2e0-46a9-8364-9f0ed28b9612 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:54.744857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42a311-f2e0-46a9-8364-9f0ed28b9612 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:54.775875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80e721-6bcb-468d-a761-fb316096426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:54.776570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80e721-6bcb-468d-a761-fb316096426b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:54.776851 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80e721-6bcb-468d-a761-fb316096426b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:54.777111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80e721-6bcb-468d-a761-fb316096426b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:54.840831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80e721-6bcb-468d-a761-fb316096426b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:54.842228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80e721-6bcb-468d-a761-fb316096426b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:54.942779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 527/1040] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:36:54.943973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff96cb-5db9-45a4-9fd8-a973fa413526 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:55.037341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff96cb-5db9-45a4-9fd8-a973fa413526 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:55.072181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6209-1c51-415a-8e50-08cd5393325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:55.072980 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6209-1c51-415a-8e50-08cd5393325e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.073257 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6209-1c51-415a-8e50-08cd5393325e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.073523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6209-1c51-415a-8e50-08cd5393325e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.084710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd6209-1c51-415a-8e50-08cd5393325e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:55.086270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd6209-1c51-415a-8e50-08cd5393325e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:55.105748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-39bd6209-1c51-415a-8e50-08cd5393325e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:55.111323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 514/1041] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:55.112544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80e721-6bcb-468d-a761-fb316096426b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:55.207906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80e721-6bcb-468d-a761-fb316096426b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:55.240015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac371d-bb15-4af8-8e44-f9f2707a550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:55.240672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac371d-bb15-4af8-8e44-f9f2707a550e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.240949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac371d-bb15-4af8-8e44-f9f2707a550e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.241220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac371d-bb15-4af8-8e44-f9f2707a550e None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.241928 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac371d-bb15-4af8-8e44-f9f2707a550e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:55.242250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac371d-bb15-4af8-8e44-f9f2707a550e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:55.243591 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac371d-bb15-4af8-8e44-f9f2707a550e None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:55.255229 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 528/1042] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:55.260797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6209-1c51-415a-8e50-08cd5393325e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:55.354919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6209-1c51-415a-8e50-08cd5393325e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:55.387692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a08436-5d4a-4b6d-83ed-ced8e78ed968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:55.388401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a08436-5d4a-4b6d-83ed-ced8e78ed968 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.388673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a08436-5d4a-4b6d-83ed-ced8e78ed968 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.388939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a08436-5d4a-4b6d-83ed-ced8e78ed968 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.395519 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a08436-5d4a-4b6d-83ed-ced8e78ed968 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:55.396937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a08436-5d4a-4b6d-83ed-ced8e78ed968 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:55.410089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-43a08436-5d4a-4b6d-83ed-ced8e78ed968 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:55.411421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 515/1043] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:55.413422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3498a10-0e5e-48f7-b5ec-be912435e625 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.413711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3498a10-0e5e-48f7-b5ec-be912435e625 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.414009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3498a10-0e5e-48f7-b5ec-be912435e625 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.415985 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 529/1044] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:55.416805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a08436-5d4a-4b6d-83ed-ced8e78ed968 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:55.421316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3febc-6495-4ec7-95b7-b7177e67cec5 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.421688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3febc-6495-4ec7-95b7-b7177e67cec5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.421965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3febc-6495-4ec7-95b7-b7177e67cec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.439406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4ed3febc-6495-4ec7-95b7-b7177e67cec5 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:55.440574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4ed3febc-6495-4ec7-95b7-b7177e67cec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:55.510062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 530/1045] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:55.518053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a08436-5d4a-4b6d-83ed-ced8e78ed968 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:55.533514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3febc-6495-4ec7-95b7-b7177e67cec5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:55.552588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d03df-b675-47a7-955e-f6b7591659b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:55.553107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d03df-b675-47a7-955e-f6b7591659b9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.553385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d03df-b675-47a7-955e-f6b7591659b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.553657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d03df-b675-47a7-955e-f6b7591659b9 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.554467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d03df-b675-47a7-955e-f6b7591659b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:55.554768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d03df-b675-47a7-955e-f6b7591659b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:55.556193 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d03df-b675-47a7-955e-f6b7591659b9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:55.568846 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 516/1046] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:55.574514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d03df-b675-47a7-955e-f6b7591659b9 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:55.634317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3febc-6495-4ec7-95b7-b7177e67cec5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:55.667081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53d401-faf2-49a2-82b4-e9e7f884d017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:55.667813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53d401-faf2-49a2-82b4-e9e7f884d017 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.668059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53d401-faf2-49a2-82b4-e9e7f884d017 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.668324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53d401-faf2-49a2-82b4-e9e7f884d017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.669382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d03df-b675-47a7-955e-f6b7591659b9 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:55.678580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53d401-faf2-49a2-82b4-e9e7f884d017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:55.685492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-cb53d401-faf2-49a2-82b4-e9e7f884d017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:36:55.686960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 531/1047] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:55.692978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53d401-faf2-49a2-82b4-e9e7f884d017 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:55.702978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804c0fc-15ab-48e0-b7b9-aabaf4ff81d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:55.703641 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804c0fc-15ab-48e0-b7b9-aabaf4ff81d0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.703920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804c0fc-15ab-48e0-b7b9-aabaf4ff81d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.704192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804c0fc-15ab-48e0-b7b9-aabaf4ff81d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.705025 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804c0fc-15ab-48e0-b7b9-aabaf4ff81d0 None admin] RBAC: Adding query filter params (role.id=27d9513a3f8d4f59a5005e708bbbf4b5, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=8182c282a5754f05b4bb6bb7057fa7ab) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:55.705334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804c0fc-15ab-48e0-b7b9-aabaf4ff81d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:55.707444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804c0fc-15ab-48e0-b7b9-aabaf4ff81d0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:55.713215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 517/1048] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:55 2022] GET /identity/v3/role_assignments?user.id=8182c282a5754f05b4bb6bb7057fa7ab&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=27d9513a3f8d4f59a5005e708bbbf4b5 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:55.797847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53d401-faf2-49a2-82b4-e9e7f884d017 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:55.834303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4449342-dee9-4407-ade4-ac03328fa8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:55.834984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4449342-dee9-4407-ade4-ac03328fa8af None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.835262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4449342-dee9-4407-ade4-ac03328fa8af None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.835533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4449342-dee9-4407-ade4-ac03328fa8af None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.836280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4449342-dee9-4407-ade4-ac03328fa8af None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:55.836578 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4449342-dee9-4407-ade4-ac03328fa8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:55.837946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4449342-dee9-4407-ade4-ac03328fa8af None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:55.849213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 532/1049] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:55.855736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804c0fc-15ab-48e0-b7b9-aabaf4ff81d0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:55.871366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21602-f8b3-439f-abf2-907944fc715f None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.871660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21602-f8b3-439f-abf2-907944fc715f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.871940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21602-f8b3-439f-abf2-907944fc715f None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.874167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 533/1050] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:55.879580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e06f-fd37-4fc3-be53-1a47810143f9 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.879854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e06f-fd37-4fc3-be53-1a47810143f9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.880128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721e06f-fd37-4fc3-be53-1a47810143f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:55.897905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-7721e06f-fd37-4fc3-be53-1a47810143f9 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:55.900183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7721e06f-fd37-4fc3-be53-1a47810143f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:55.962532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804c0fc-15ab-48e0-b7b9-aabaf4ff81d0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:55.970032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 534/1051] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:55.990405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e06f-fd37-4fc3-be53-1a47810143f9 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:55.995776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538e71f-6178-4a17-8039-d8ee0f053897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:55.996649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538e71f-6178-4a17-8039-d8ee0f053897 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:55.996931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538e71f-6178-4a17-8039-d8ee0f053897 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:55.997202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538e71f-6178-4a17-8039-d8ee0f053897 None admin] PATH_INFO: `/v3/users/f1e0509895f149e6bd34099383b41a23` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:56.011832 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538e71f-6178-4a17-8039-d8ee0f053897 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e0509895f149e6bd34099383b41a23)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:56.013271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538e71f-6178-4a17-8039-d8ee0f053897 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:56.019492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 518/1052] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:36:55 2022] GET /identity/v3/users/f1e0509895f149e6bd34099383b41a23 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:56.020891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538e71f-6178-4a17-8039-d8ee0f053897 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:56.092941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721e06f-fd37-4fc3-be53-1a47810143f9 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:56.119326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538e71f-6178-4a17-8039-d8ee0f053897 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:56.126338 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d040473-fa49-479a-b9b7-220f8b7ac40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:56.127163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d040473-fa49-479a-b9b7-220f8b7ac40b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:56.127452 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d040473-fa49-479a-b9b7-220f8b7ac40b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:56.127715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d040473-fa49-479a-b9b7-220f8b7ac40b None admin] PATH_INFO: `/v3/services/image` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:56.128965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d040473-fa49-479a-b9b7-220f8b7ac40b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:56.130323 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d040473-fa49-479a-b9b7-220f8b7ac40b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:56.141422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-5d040473-fa49-479a-b9b7-220f8b7ac40b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 28 21:36:56.142776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 535/1053] 10.222.0.26 () {56 vars in 1105 bytes} [Mon Feb 28 21:36:55 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:56.148649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d040473-fa49-479a-b9b7-220f8b7ac40b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:56.158359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4ab47-51a6-468b-b361-bf224ae6d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:56.158819 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4ab47-51a6-468b-b361-bf224ae6d237 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:56.159097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4ab47-51a6-468b-b361-bf224ae6d237 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:56.159367 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4ab47-51a6-468b-b361-bf224ae6d237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:56.224514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4ab47-51a6-468b-b361-bf224ae6d237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:56.225892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4ab47-51a6-468b-b361-bf224ae6d237 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:56.244836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d040473-fa49-479a-b9b7-220f8b7ac40b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:56.277829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacf7d9-6af0-4a2d-bdbf-b0d0f51fa77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:56.278519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf7d9-6af0-4a2d-bdbf-b0d0f51fa77a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:56.278800 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf7d9-6af0-4a2d-bdbf-b0d0f51fa77a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:56.279074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacf7d9-6af0-4a2d-bdbf-b0d0f51fa77a None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:56.279776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacf7d9-6af0-4a2d-bdbf-b0d0f51fa77a None admin] RBAC: Adding query filter params (name=image) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:56.280246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacf7d9-6af0-4a2d-bdbf-b0d0f51fa77a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:56.281413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacf7d9-6af0-4a2d-bdbf-b0d0f51fa77a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:56.287110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 536/1054] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:56.292495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacf7d9-6af0-4a2d-bdbf-b0d0f51fa77a None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:56.323327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 519/1055] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:36:56.328810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4ab47-51a6-468b-b361-bf224ae6d237 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:56.386354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacf7d9-6af0-4a2d-bdbf-b0d0f51fa77a None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:56.418787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c733d3-b84c-44c3-ac41-b5bbaf82eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:56.419453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c733d3-b84c-44c3-ac41-b5bbaf82eb4d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:56.419729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c733d3-b84c-44c3-ac41-b5bbaf82eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:56.419999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c733d3-b84c-44c3-ac41-b5bbaf82eb4d None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:56.420698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c733d3-b84c-44c3-ac41-b5bbaf82eb4d None admin] RBAC: Adding query filter params (type=image) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:56.420996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c733d3-b84c-44c3-ac41-b5bbaf82eb4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:56.422363 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c733d3-b84c-44c3-ac41-b5bbaf82eb4d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:56.423103 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4ab47-51a6-468b-b361-bf224ae6d237 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:56.427938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 537/1056] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:56.433309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c733d3-b84c-44c3-ac41-b5bbaf82eb4d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:56.457677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e931851-355d-4c01-823d-d638d2691a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:56.458568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e931851-355d-4c01-823d-d638d2691a7d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:56.458844 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e931851-355d-4c01-823d-d638d2691a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:56.459114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e931851-355d-4c01-823d-d638d2691a7d None admin] PATH_INFO: `/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:56.460295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e931851-355d-4c01-823d-d638d2691a7d None admin] RBAC: Authorizing `identity:get_project(project_id=2b2d49c1b00547de99f4e3b38e9ec68a)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:56.461716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e931851-355d-4c01-823d-d638d2691a7d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:56.463468 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 520/1057] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:36:56 2022] GET /identity/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:56.469474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e931851-355d-4c01-823d-d638d2691a7d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:56.530988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c733d3-b84c-44c3-ac41-b5bbaf82eb4d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:56.564581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a20168-3a5c-482c-853f-37dc71079bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:56.565230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20168-3a5c-482c-853f-37dc71079bd3 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:56.565505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20168-3a5c-482c-853f-37dc71079bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:56.565866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20168-3a5c-482c-853f-37dc71079bd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:56.566798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a20168-3a5c-482c-853f-37dc71079bd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:56.567354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e931851-355d-4c01-823d-d638d2691a7d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:56.568153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a20168-3a5c-482c-853f-37dc71079bd3 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:56.601137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bea469-878e-4758-a755-32bd663c8877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:56.601789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea469-878e-4758-a755-32bd663c8877 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:56.602104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea469-878e-4758-a755-32bd663c8877 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:56.602376 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea469-878e-4758-a755-32bd663c8877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:56.603189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bea469-878e-4758-a755-32bd663c8877 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=2b2d49c1b00547de99f4e3b38e9ec68a, user.id=f1e0509895f149e6bd34099383b41a23) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:56.603492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bea469-878e-4758-a755-32bd663c8877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:56.604894 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bea469-878e-4758-a755-32bd663c8877 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:56.622068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 521/1058] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:36:56 2022] GET /identity/v3/role_assignments?user.id=f1e0509895f149e6bd34099383b41a23&scope.project.id=2b2d49c1b00547de99f4e3b38e9ec68a&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:56.653237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 538/1059] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Feb 28 21:36:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:36:58.058050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d930-c82f-42ec-a2ff-bb7e976bf22a None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:58.058563 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d930-c82f-42ec-a2ff-bb7e976bf22a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:58.058639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d930-c82f-42ec-a2ff-bb7e976bf22a None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:58.060398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 522/1060] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:58.065701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd69c9e-6524-4a89-83db-8beab39a64fe None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:58.066648 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd69c9e-6524-4a89-83db-8beab39a64fe None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:58.066831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd69c9e-6524-4a89-83db-8beab39a64fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:58.083499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-1cd69c9e-6524-4a89-83db-8beab39a64fe None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:58.084666 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1cd69c9e-6524-4a89-83db-8beab39a64fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:58.156657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 539/1061] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:36:58.180162 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956d930-c82f-42ec-a2ff-bb7e976bf22a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:58.279724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956d930-c82f-42ec-a2ff-bb7e976bf22a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:58.312756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad741a-4327-44b0-885d-435f45d25668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:58.313566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad741a-4327-44b0-885d-435f45d25668 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:58.313846 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad741a-4327-44b0-885d-435f45d25668 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:58.314149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad741a-4327-44b0-885d-435f45d25668 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:58.324196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad741a-4327-44b0-885d-435f45d25668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:58.331698 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-f5ad741a-4327-44b0-885d-435f45d25668 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 21:36:58.333082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 523/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Feb 28 21:36:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:58.338869 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd69c9e-6524-4a89-83db-8beab39a64fe None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:58.434917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd69c9e-6524-4a89-83db-8beab39a64fe None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:58.467782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b3053-518d-42df-9bc1-29f605afabd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:58.468450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b3053-518d-42df-9bc1-29f605afabd7 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:58.468729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b3053-518d-42df-9bc1-29f605afabd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:58.468998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b3053-518d-42df-9bc1-29f605afabd7 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:58.469739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b3053-518d-42df-9bc1-29f605afabd7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:58.470075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b3053-518d-42df-9bc1-29f605afabd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:58.471439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b3053-518d-42df-9bc1-29f605afabd7 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:58.484545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 540/1063] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Feb 28 21:36:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:58.486210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad741a-4327-44b0-885d-435f45d25668 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:58.590288 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad741a-4327-44b0-885d-435f45d25668 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:58.629120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f5f12-86f9-4993-bfa9-9f174daab568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:58.629958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f5f12-86f9-4993-bfa9-9f174daab568 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:58.630273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f5f12-86f9-4993-bfa9-9f174daab568 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:58.630797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f5f12-86f9-4993-bfa9-9f174daab568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:58.643619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f5f12-86f9-4993-bfa9-9f174daab568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:58.646389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f5f12-86f9-4993-bfa9-9f174daab568 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:58.664337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-636f5f12-86f9-4993-bfa9-9f174daab568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:58.665752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 524/1064] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:58.671251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b3053-518d-42df-9bc1-29f605afabd7 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:58.767674 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b3053-518d-42df-9bc1-29f605afabd7 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:58.800603 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a8750-fce2-42b7-aa24-05c32e8bb2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:58.801266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a8750-fce2-42b7-aa24-05c32e8bb2b4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:58.801547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a8750-fce2-42b7-aa24-05c32e8bb2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:58.801819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a8750-fce2-42b7-aa24-05c32e8bb2b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:58.802564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a8750-fce2-42b7-aa24-05c32e8bb2b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:58.802870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a8750-fce2-42b7-aa24-05c32e8bb2b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:58.804220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a8750-fce2-42b7-aa24-05c32e8bb2b4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:58.819736 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 541/1065] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:58.821423 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f5f12-86f9-4993-bfa9-9f174daab568 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:58.947068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63547034-a66a-460c-acd5-aa7f367419c6 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:58.947351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63547034-a66a-460c-acd5-aa7f367419c6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:58.947627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63547034-a66a-460c-acd5-aa7f367419c6 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:58.949420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 542/1066] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:36:58.954317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436aff-c092-4e28-96b6-f0a26328e17a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:58.954603 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436aff-c092-4e28-96b6-f0a26328e17a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:58.954878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436aff-c092-4e28-96b6-f0a26328e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:58.980698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2a436aff-c092-4e28-96b6-f0a26328e17a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:58.981902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2a436aff-c092-4e28-96b6-f0a26328e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:59.000404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f5f12-86f9-4993-bfa9-9f174daab568 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.032927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18fc70-08df-42c4-8622-1f68e300cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.033645 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18fc70-08df-42c4-8622-1f68e300cd2f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.034069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18fc70-08df-42c4-8622-1f68e300cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.034908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18fc70-08df-42c4-8622-1f68e300cd2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.042209 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18fc70-08df-42c4-8622-1f68e300cd2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:59.043664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18fc70-08df-42c4-8622-1f68e300cd2f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:59.047925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 543/1067] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:59.049525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f5e9d-df37-46f6-8acc-583ea9b17e27 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.049817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f5e9d-df37-46f6-8acc-583ea9b17e27 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.050200 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f5e9d-df37-46f6-8acc-583ea9b17e27 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.051847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 544/1068] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:36:59.057131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235db6db-f644-4b76-84c7-17995617ce2f None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.057414 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235db6db-f644-4b76-84c7-17995617ce2f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.057687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235db6db-f644-4b76-84c7-17995617ce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.060550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-4c18fc70-08df-42c4-8622-1f68e300cd2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 21:36:59.068111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 525/1069] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Feb 28 21:36:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:36:59.068956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18fc70-08df-42c4-8622-1f68e300cd2f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.075757 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-235db6db-f644-4b76-84c7-17995617ce2f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:36:59.076932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-235db6db-f644-4b76-84c7-17995617ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:36:59.139713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 545/1070] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:36:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:36:59.140539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235db6db-f644-4b76-84c7-17995617ce2f None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.164346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18fc70-08df-42c4-8622-1f68e300cd2f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.196845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becbea6-089b-48ed-a7ca-4e86ba8345d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.197514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becbea6-089b-48ed-a7ca-4e86ba8345d6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.197793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becbea6-089b-48ed-a7ca-4e86ba8345d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.198092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becbea6-089b-48ed-a7ca-4e86ba8345d6 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.198929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becbea6-089b-48ed-a7ca-4e86ba8345d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:59.199234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becbea6-089b-48ed-a7ca-4e86ba8345d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:59.200664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becbea6-089b-48ed-a7ca-4e86ba8345d6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:59.217541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 526/1071] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:36:59.218360 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becbea6-089b-48ed-a7ca-4e86ba8345d6 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.235787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235db6db-f644-4b76-84c7-17995617ce2f None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.267894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684afee0-5bb4-4f58-9ab6-c156c98d4fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.268924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684afee0-5bb4-4f58-9ab6-c156c98d4fe1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.269218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684afee0-5bb4-4f58-9ab6-c156c98d4fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.269353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684afee0-5bb4-4f58-9ab6-c156c98d4fe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.278834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684afee0-5bb4-4f58-9ab6-c156c98d4fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:36:59.286239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-684afee0-5bb4-4f58-9ab6-c156c98d4fe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:36:59.287490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 546/1072] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:59.288096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684afee0-5bb4-4f58-9ab6-c156c98d4fe1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.311310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becbea6-089b-48ed-a7ca-4e86ba8345d6 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.343054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef64ba-0223-414a-9709-2d4b8b3f7df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.343690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef64ba-0223-414a-9709-2d4b8b3f7df8 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.343970 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef64ba-0223-414a-9709-2d4b8b3f7df8 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.344243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef64ba-0223-414a-9709-2d4b8b3f7df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.382738 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684afee0-5bb4-4f58-9ab6-c156c98d4fe1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.411583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef64ba-0223-414a-9709-2d4b8b3f7df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:59.413149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef64ba-0223-414a-9709-2d4b8b3f7df8 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:59.415581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f96c9-f51d-4a35-b07c-7ce3ae837ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.416380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f96c9-f51d-4a35-b07c-7ce3ae837ce2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.416664 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f96c9-f51d-4a35-b07c-7ce3ae837ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.416937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f96c9-f51d-4a35-b07c-7ce3ae837ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.427577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f96c9-f51d-4a35-b07c-7ce3ae837ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:59.429011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f96c9-f51d-4a35-b07c-7ce3ae837ce2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:59.444845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-e36f96c9-f51d-4a35-b07c-7ce3ae837ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:59.446086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 547/1073] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:59.446793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f96c9-f51d-4a35-b07c-7ce3ae837ce2 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.507066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 527/1074] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:36:59.507744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef64ba-0223-414a-9709-2d4b8b3f7df8 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.546083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f96c9-f51d-4a35-b07c-7ce3ae837ce2 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.573569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea35e-7e57-46fd-9592-dee0fee71775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.575379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea35e-7e57-46fd-9592-dee0fee71775 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.575379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea35e-7e57-46fd-9592-dee0fee71775 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.575379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeea35e-7e57-46fd-9592-dee0fee71775 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.575634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea35e-7e57-46fd-9592-dee0fee71775 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:59.575936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea35e-7e57-46fd-9592-dee0fee71775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:59.577292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeea35e-7e57-46fd-9592-dee0fee71775 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:59.585647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 548/1075] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:59.586475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea35e-7e57-46fd-9592-dee0fee71775 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.603265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef64ba-0223-414a-9709-2d4b8b3f7df8 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.635350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee29dc-733f-4872-a50d-b858de483697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.636019 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee29dc-733f-4872-a50d-b858de483697 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.636299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee29dc-733f-4872-a50d-b858de483697 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.636571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee29dc-733f-4872-a50d-b858de483697 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.637284 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee29dc-733f-4872-a50d-b858de483697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:59.637584 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee29dc-733f-4872-a50d-b858de483697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:59.639013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee29dc-733f-4872-a50d-b858de483697 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:59.650525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 528/1076] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:59.651303 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee29dc-733f-4872-a50d-b858de483697 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.684342 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeea35e-7e57-46fd-9592-dee0fee71775 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.716188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f279bd-ba91-4557-a7df-21b9f4ba9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.716964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f279bd-ba91-4557-a7df-21b9f4ba9bbd None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.717245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f279bd-ba91-4557-a7df-21b9f4ba9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.717513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f279bd-ba91-4557-a7df-21b9f4ba9bbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.727735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f279bd-ba91-4557-a7df-21b9f4ba9bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:59.729289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f279bd-ba91-4557-a7df-21b9f4ba9bbd None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:59.743943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee29dc-733f-4872-a50d-b858de483697 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.745770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-50f279bd-ba91-4557-a7df-21b9f4ba9bbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:36:59.746955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 549/1077] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:59.747705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f279bd-ba91-4557-a7df-21b9f4ba9bbd None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.776558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb086-8c95-41fa-ab45-c8e90dfb36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.777412 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb086-8c95-41fa-ab45-c8e90dfb36e2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.777684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb086-8c95-41fa-ab45-c8e90dfb36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.777949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eb086-8c95-41fa-ab45-c8e90dfb36e2 None admin] PATH_INFO: `/v3/users/f1e0509895f149e6bd34099383b41a23` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.779151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17eb086-8c95-41fa-ab45-c8e90dfb36e2 None admin] RBAC: Authorizing `identity:get_user(user_id=f1e0509895f149e6bd34099383b41a23)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:59.780562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17eb086-8c95-41fa-ab45-c8e90dfb36e2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:59.782192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 529/1078] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/users/f1e0509895f149e6bd34099383b41a23 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:59.782929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb086-8c95-41fa-ab45-c8e90dfb36e2 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.843428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f279bd-ba91-4557-a7df-21b9f4ba9bbd None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.876945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd5122-5203-4bce-9997-a2b648386124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.877736 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5122-5203-4bce-9997-a2b648386124 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.878096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5122-5203-4bce-9997-a2b648386124 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.878457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd5122-5203-4bce-9997-a2b648386124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.881330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eb086-8c95-41fa-ab45-c8e90dfb36e2 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:36:59.885114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd5122-5203-4bce-9997-a2b648386124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:59.886588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd5122-5203-4bce-9997-a2b648386124 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:59.899972 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-45dd5122-5203-4bce-9997-a2b648386124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:36:59.901160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 550/1079] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:36:59.901884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd5122-5203-4bce-9997-a2b648386124 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:36:59.914076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b61fb1-3bc0-4225-93f1-2cb3543879b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:36:59.914945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b61fb1-3bc0-4225-93f1-2cb3543879b4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:36:59.915220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b61fb1-3bc0-4225-93f1-2cb3543879b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:36:59.915489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b61fb1-3bc0-4225-93f1-2cb3543879b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:36:59.916198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b61fb1-3bc0-4225-93f1-2cb3543879b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:36:59.916499 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b61fb1-3bc0-4225-93f1-2cb3543879b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:36:59.917835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b61fb1-3bc0-4225-93f1-2cb3543879b4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:36:59.929858 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 530/1080] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:36:59.930757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b61fb1-3bc0-4225-93f1-2cb3543879b4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:00.003351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd5122-5203-4bce-9997-a2b648386124 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:00.037380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b61fb1-3bc0-4225-93f1-2cb3543879b4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:00.039794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acf0a7-1907-4c5a-9e3d-07b14f42a9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:00.040668 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acf0a7-1907-4c5a-9e3d-07b14f42a9b0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:00.040944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acf0a7-1907-4c5a-9e3d-07b14f42a9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:00.041215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acf0a7-1907-4c5a-9e3d-07b14f42a9b0 None admin] PATH_INFO: `/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:00.042460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acf0a7-1907-4c5a-9e3d-07b14f42a9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=2b2d49c1b00547de99f4e3b38e9ec68a)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:00.043925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acf0a7-1907-4c5a-9e3d-07b14f42a9b0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:00.045815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 551/1081] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:00.052238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acf0a7-1907-4c5a-9e3d-07b14f42a9b0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:00.074308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd657a5f-96e8-4b43-96f2-ff9daf37f341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:00.074993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd657a5f-96e8-4b43-96f2-ff9daf37f341 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:00.075274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd657a5f-96e8-4b43-96f2-ff9daf37f341 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:00.075542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd657a5f-96e8-4b43-96f2-ff9daf37f341 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:00.076335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd657a5f-96e8-4b43-96f2-ff9daf37f341 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:00.076643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd657a5f-96e8-4b43-96f2-ff9daf37f341 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:00.078118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd657a5f-96e8-4b43-96f2-ff9daf37f341 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:00.096494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 531/1082] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:00.097853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd657a5f-96e8-4b43-96f2-ff9daf37f341 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:00.158547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acf0a7-1907-4c5a-9e3d-07b14f42a9b0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:00.197025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc58ef4-3b9a-4a52-a946-a66f336bdad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:00.197911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc58ef4-3b9a-4a52-a946-a66f336bdad6 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:00.198225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc58ef4-3b9a-4a52-a946-a66f336bdad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:00.198494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc58ef4-3b9a-4a52-a946-a66f336bdad6 None admin] PATH_INFO: `/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a/users/f1e0509895f149e6bd34099383b41a23/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:00.200519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc58ef4-3b9a-4a52-a946-a66f336bdad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b2d49c1b00547de99f4e3b38e9ec68a, user_id=f1e0509895f149e6bd34099383b41a23, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:00.201936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc58ef4-3b9a-4a52-a946-a66f336bdad6 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:00.210424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd657a5f-96e8-4b43-96f2-ff9daf37f341 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:00.244763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd9eef-f6ba-4e1f-9274-320f2e52cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:00.245650 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd9eef-f6ba-4e1f-9274-320f2e52cf3d None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:00.245935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd9eef-f6ba-4e1f-9274-320f2e52cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:00.246245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd9eef-f6ba-4e1f-9274-320f2e52cf3d None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/8182c282a5754f05b4bb6bb7057fa7ab/roles/27d9513a3f8d4f59a5005e708bbbf4b5` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:00.248477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd9eef-f6ba-4e1f-9274-320f2e52cf3d None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=8182c282a5754f05b4bb6bb7057fa7ab, role_id=27d9513a3f8d4f59a5005e708bbbf4b5)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:00.249893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd9eef-f6ba-4e1f-9274-320f2e52cf3d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:00.285958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 552/1083] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:37:00 2022] PUT /identity/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a/users/f1e0509895f149e6bd34099383b41a23/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:37:00.361024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 532/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:37:00 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/8182c282a5754f05b4bb6bb7057fa7ab/roles/27d9513a3f8d4f59a5005e708bbbf4b5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:37:02.570935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b650-138a-4a5a-9455-be3a85f7b317 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:02.571463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b650-138a-4a5a-9455-be3a85f7b317 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:02.571463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70b650-138a-4a5a-9455-be3a85f7b317 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:02.573238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 553/1085] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:02.578419 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0422f6-6dee-42f3-ae1a-51307b5858ba None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:02.578827 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0422f6-6dee-42f3-ae1a-51307b5858ba None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:02.578970 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0422f6-6dee-42f3-ae1a-51307b5858ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:02.595862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-3e0422f6-6dee-42f3-ae1a-51307b5858ba None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:02.597604 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3e0422f6-6dee-42f3-ae1a-51307b5858ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:02.653316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc7cd5-578b-4e5e-ae2c-fa89916342f2 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:02.653595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc7cd5-578b-4e5e-ae2c-fa89916342f2 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:02.653867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc7cd5-578b-4e5e-ae2c-fa89916342f2 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:02.655650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 554/1086] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:37:02.661202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412dca1-b28c-4df0-a5e8-342093cb2f73 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:02.661490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412dca1-b28c-4df0-a5e8-342093cb2f73 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:02.661747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 533/1087] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:02.661914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412dca1-b28c-4df0-a5e8-342093cb2f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:02.677806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-6412dca1-b28c-4df0-a5e8-342093cb2f73 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:02.679086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-6412dca1-b28c-4df0-a5e8-342093cb2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:02.684833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0422f6-6dee-42f3-ae1a-51307b5858ba None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:02.741938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 555/1088] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:37:02.766110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412dca1-b28c-4df0-a5e8-342093cb2f73 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:02.778498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0422f6-6dee-42f3-ae1a-51307b5858ba None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:02.810049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70715320-d21c-458f-b144-a773633bc9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:02.810842 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70715320-d21c-458f-b144-a773633bc9a4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:02.811117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70715320-d21c-458f-b144-a773633bc9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:02.811385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70715320-d21c-458f-b144-a773633bc9a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:02.824658 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70715320-d21c-458f-b144-a773633bc9a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:37:02.832264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-70715320-d21c-458f-b144-a773633bc9a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:37:02.833490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 534/1089] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:37:02.839467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70715320-d21c-458f-b144-a773633bc9a4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:02.858830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412dca1-b28c-4df0-a5e8-342093cb2f73 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:02.891667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2abc8-5bc0-4cc2-9ba0-22c2f5e4aca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:02.892532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2abc8-5bc0-4cc2-9ba0-22c2f5e4aca9 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:02.892808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2abc8-5bc0-4cc2-9ba0-22c2f5e4aca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:02.893075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2abc8-5bc0-4cc2-9ba0-22c2f5e4aca9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:02.902890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2abc8-5bc0-4cc2-9ba0-22c2f5e4aca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:37:02.910724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-d8f2abc8-5bc0-4cc2-9ba0-22c2f5e4aca9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 28 21:37:02.911894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 556/1090] 10.222.0.26 () {56 vars in 1120 bytes} [Mon Feb 28 21:37:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:37:02.917855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2abc8-5bc0-4cc2-9ba0-22c2f5e4aca9 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:02.934084 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70715320-d21c-458f-b144-a773633bc9a4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:02.964868 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca23455-9934-4c4d-8796-26b4ab3f031b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:02.965516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23455-9934-4c4d-8796-26b4ab3f031b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:02.965792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23455-9934-4c4d-8796-26b4ab3f031b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:02.966099 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca23455-9934-4c4d-8796-26b4ab3f031b None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:02.966829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca23455-9934-4c4d-8796-26b4ab3f031b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:02.967123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca23455-9934-4c4d-8796-26b4ab3f031b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:02.968465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca23455-9934-4c4d-8796-26b4ab3f031b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:02.976728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 535/1091] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:37:02.982278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca23455-9934-4c4d-8796-26b4ab3f031b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:03.010765 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2abc8-5bc0-4cc2-9ba0-22c2f5e4aca9 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:03.042841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d089e8c-09a4-4ac0-ae1f-3d5d44bd6766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:03.043498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089e8c-09a4-4ac0-ae1f-3d5d44bd6766 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:03.043777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089e8c-09a4-4ac0-ae1f-3d5d44bd6766 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:03.044049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089e8c-09a4-4ac0-ae1f-3d5d44bd6766 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:03.044789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d089e8c-09a4-4ac0-ae1f-3d5d44bd6766 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:03.045091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d089e8c-09a4-4ac0-ae1f-3d5d44bd6766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:03.046475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d089e8c-09a4-4ac0-ae1f-3d5d44bd6766 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:03.054470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 557/1092] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Feb 28 21:37:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:37:03.059811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d089e8c-09a4-4ac0-ae1f-3d5d44bd6766 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:03.075369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca23455-9934-4c4d-8796-26b4ab3f031b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:03.107677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460dc30-2654-4665-a2c7-66bf4c5f4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:03.108550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460dc30-2654-4665-a2c7-66bf4c5f4b8b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:03.108830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460dc30-2654-4665-a2c7-66bf4c5f4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:03.109102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460dc30-2654-4665-a2c7-66bf4c5f4b8b None admin] PATH_INFO: `/v3/users/f1e0509895f149e6bd34099383b41a23` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:03.110316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460dc30-2654-4665-a2c7-66bf4c5f4b8b None admin] RBAC: Authorizing `identity:get_user(user_id=f1e0509895f149e6bd34099383b41a23)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:03.111730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460dc30-2654-4665-a2c7-66bf4c5f4b8b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:03.113481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 536/1093] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:02 2022] GET /identity/v3/users/f1e0509895f149e6bd34099383b41a23 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:37:03.119040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460dc30-2654-4665-a2c7-66bf4c5f4b8b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:03.155345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d089e8c-09a4-4ac0-ae1f-3d5d44bd6766 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:03.187338 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba663a8d-78f9-4169-8da0-412016784f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:03.188119 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663a8d-78f9-4169-8da0-412016784f37 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:03.188395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663a8d-78f9-4169-8da0-412016784f37 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:03.188668 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba663a8d-78f9-4169-8da0-412016784f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:03.199874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba663a8d-78f9-4169-8da0-412016784f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:03.201309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba663a8d-78f9-4169-8da0-412016784f37 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:03.211907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460dc30-2654-4665-a2c7-66bf4c5f4b8b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:03.217131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-ba663a8d-78f9-4169-8da0-412016784f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:37:03.218316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 558/1094] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:37:03.224195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba663a8d-78f9-4169-8da0-412016784f37 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:03.244821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118f3f-796a-4058-ac4a-69cf54d01ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:03.245464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118f3f-796a-4058-ac4a-69cf54d01ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:03.245742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118f3f-796a-4058-ac4a-69cf54d01ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:03.246042 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118f3f-796a-4058-ac4a-69cf54d01ee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:03.310122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36118f3f-796a-4058-ac4a-69cf54d01ee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:03.311580 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36118f3f-796a-4058-ac4a-69cf54d01ee0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:03.317939 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba663a8d-78f9-4169-8da0-412016784f37 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:03.349536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4603724-5e11-4d44-afb7-97c1659731fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:03.350140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4603724-5e11-4d44-afb7-97c1659731fd None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:03.350415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4603724-5e11-4d44-afb7-97c1659731fd None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:03.350679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4603724-5e11-4d44-afb7-97c1659731fd None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:03.351388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4603724-5e11-4d44-afb7-97c1659731fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:03.351687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4603724-5e11-4d44-afb7-97c1659731fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:03.353036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4603724-5e11-4d44-afb7-97c1659731fd None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:03.364844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 559/1095] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:37:03.370522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4603724-5e11-4d44-afb7-97c1659731fd None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:03.411587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 537/1096] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:37:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 21:37:03.412703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118f3f-796a-4058-ac4a-69cf54d01ee0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:03.462807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4603724-5e11-4d44-afb7-97c1659731fd None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:03.494082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ce97-1e00-4e4a-b0a7-fd185f076dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:03.494852 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ce97-1e00-4e4a-b0a7-fd185f076dc8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:03.495128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ce97-1e00-4e4a-b0a7-fd185f076dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:03.495394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ce97-1e00-4e4a-b0a7-fd185f076dc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:03.502103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0ce97-1e00-4e4a-b0a7-fd185f076dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:03.504176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0ce97-1e00-4e4a-b0a7-fd185f076dc8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:03.508429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118f3f-796a-4058-ac4a-69cf54d01ee0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:03.517467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-3ab0ce97-1e00-4e4a-b0a7-fd185f076dc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 28 21:37:03.518866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 560/1097] 10.222.0.26 () {56 vars in 1093 bytes} [Mon Feb 28 21:37:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:37:03.524501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ce97-1e00-4e4a-b0a7-fd185f076dc8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:03.541523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab951bf6-68f7-40fb-8323-761a7f292c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:03.542482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951bf6-68f7-40fb-8323-761a7f292c5f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:03.542766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951bf6-68f7-40fb-8323-761a7f292c5f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:03.543047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951bf6-68f7-40fb-8323-761a7f292c5f None admin] PATH_INFO: `/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:03.544214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab951bf6-68f7-40fb-8323-761a7f292c5f None admin] RBAC: Authorizing `identity:get_project(project_id=2b2d49c1b00547de99f4e3b38e9ec68a)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:03.545650 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab951bf6-68f7-40fb-8323-761a7f292c5f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:03.547565 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 538/1098] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:37:03 2022] GET /identity/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:37:03.553177 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab951bf6-68f7-40fb-8323-761a7f292c5f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:03.618775 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ce97-1e00-4e4a-b0a7-fd185f076dc8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:03.646088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab951bf6-68f7-40fb-8323-761a7f292c5f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:03.650679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3323ccf-d435-4054-89ea-f535cd180ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:03.651352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3323ccf-d435-4054-89ea-f535cd180ebe None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:03.651637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3323ccf-d435-4054-89ea-f535cd180ebe None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:03.651911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3323ccf-d435-4054-89ea-f535cd180ebe None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:03.652737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3323ccf-d435-4054-89ea-f535cd180ebe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:03.653041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3323ccf-d435-4054-89ea-f535cd180ebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:03.654612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3323ccf-d435-4054-89ea-f535cd180ebe None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:03.671556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 561/1099] 10.222.0.26 () {56 vars in 1133 bytes} [Mon Feb 28 21:37:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:37:03.678097 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3323ccf-d435-4054-89ea-f535cd180ebe None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:03.679253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7b81-80d4-4952-a11d-7c7e2b681be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:03.679897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7b81-80d4-4952-a11d-7c7e2b681be8 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:03.680172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7b81-80d4-4952-a11d-7c7e2b681be8 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:03.680441 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7b81-80d4-4952-a11d-7c7e2b681be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:03.681258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c7b81-80d4-4952-a11d-7c7e2b681be8 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=2b2d49c1b00547de99f4e3b38e9ec68a, user.id=f1e0509895f149e6bd34099383b41a23) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:03.681557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c7b81-80d4-4952-a11d-7c7e2b681be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:03.682976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c7b81-80d4-4952-a11d-7c7e2b681be8 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:03.688559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 539/1100] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:37:03 2022] GET /identity/v3/role_assignments?user.id=f1e0509895f149e6bd34099383b41a23&scope.project.id=2b2d49c1b00547de99f4e3b38e9ec68a&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:37:03.780403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3323ccf-d435-4054-89ea-f535cd180ebe None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:03.817719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576264c-26ea-4f0a-a5b5-5ff319edca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:03.817719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576264c-26ea-4f0a-a5b5-5ff319edca03 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:03.817719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576264c-26ea-4f0a-a5b5-5ff319edca03 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:03.817719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576264c-26ea-4f0a-a5b5-5ff319edca03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:03.887915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576264c-26ea-4f0a-a5b5-5ff319edca03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:03.889303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576264c-26ea-4f0a-a5b5-5ff319edca03 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:03.982919 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 562/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:37:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Feb 28 21:37:03.988833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7b81-80d4-4952-a11d-7c7e2b681be8 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:04.082892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7b81-80d4-4952-a11d-7c7e2b681be8 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:04.114868 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea8ab7-7bfc-4403-b963-725f9b7885e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:04.115651 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea8ab7-7bfc-4403-b963-725f9b7885e5 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:04.115928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea8ab7-7bfc-4403-b963-725f9b7885e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:04.116197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea8ab7-7bfc-4403-b963-725f9b7885e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:04.125693 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea8ab7-7bfc-4403-b963-725f9b7885e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:04.127153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea8ab7-7bfc-4403-b963-725f9b7885e5 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:04.144329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-8aea8ab7-7bfc-4403-b963-725f9b7885e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:37:04.145588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 540/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:37:04.151151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576264c-26ea-4f0a-a5b5-5ff319edca03 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:04.243772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576264c-26ea-4f0a-a5b5-5ff319edca03 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:04.280920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9081e-6b87-4a91-9fa3-c1810a0b493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:04.281573 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9081e-6b87-4a91-9fa3-c1810a0b493c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:04.281854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9081e-6b87-4a91-9fa3-c1810a0b493c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:04.282159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9081e-6b87-4a91-9fa3-c1810a0b493c None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:04.282877 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9081e-6b87-4a91-9fa3-c1810a0b493c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:04.283175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9081e-6b87-4a91-9fa3-c1810a0b493c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:04.284589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9081e-6b87-4a91-9fa3-c1810a0b493c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:04.295208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 563/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:04.300864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea8ab7-7bfc-4403-b963-725f9b7885e5 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:04.395293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea8ab7-7bfc-4403-b963-725f9b7885e5 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:04.426787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062498a-3ace-4919-8d85-cce724a466e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:04.427566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062498a-3ace-4919-8d85-cce724a466e4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:04.427838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062498a-3ace-4919-8d85-cce724a466e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:04.428102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062498a-3ace-4919-8d85-cce724a466e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:04.434456 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062498a-3ace-4919-8d85-cce724a466e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:04.435877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062498a-3ace-4919-8d85-cce724a466e4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:04.449912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-c062498a-3ace-4919-8d85-cce724a466e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:37:04.451120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 541/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:37:04.457574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9081e-6b87-4a91-9fa3-c1810a0b493c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:04.550760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9081e-6b87-4a91-9fa3-c1810a0b493c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:04.582771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694f0e0-5220-498d-9f81-af02869125d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:04.583422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694f0e0-5220-498d-9f81-af02869125d2 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:04.583700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694f0e0-5220-498d-9f81-af02869125d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:04.583968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694f0e0-5220-498d-9f81-af02869125d2 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:04.584735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694f0e0-5220-498d-9f81-af02869125d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:04.585036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694f0e0-5220-498d-9f81-af02869125d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:04.586487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694f0e0-5220-498d-9f81-af02869125d2 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:04.598017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 564/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:37:04.604164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062498a-3ace-4919-8d85-cce724a466e4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:04.698263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062498a-3ace-4919-8d85-cce724a466e4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:04.730786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8ff11-266a-4832-b087-9c8d64c18ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:04.731430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ff11-266a-4832-b087-9c8d64c18ffd None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:04.731710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ff11-266a-4832-b087-9c8d64c18ffd None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:04.731985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ff11-266a-4832-b087-9c8d64c18ffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:04.732802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8ff11-266a-4832-b087-9c8d64c18ffd None admin] RBAC: Adding query filter params (role.id=27d9513a3f8d4f59a5005e708bbbf4b5, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=8182c282a5754f05b4bb6bb7057fa7ab) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:04.733110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8ff11-266a-4832-b087-9c8d64c18ffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:04.734558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8ff11-266a-4832-b087-9c8d64c18ffd None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:04.740503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 542/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:37:04 2022] GET /identity/v3/role_assignments?user.id=8182c282a5754f05b4bb6bb7057fa7ab&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=27d9513a3f8d4f59a5005e708bbbf4b5 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:06.022137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebbc16-cd34-4b05-baa8-a147c2a68245 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:06.022688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebbc16-cd34-4b05-baa8-a147c2a68245 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:06.022688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebbc16-cd34-4b05-baa8-a147c2a68245 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:06.024445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 565/1107] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:06.029745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69a85-c513-4c11-a962-1c1082836dcf None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:06.030210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69a85-c513-4c11-a962-1c1082836dcf None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:06.030335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec69a85-c513-4c11-a962-1c1082836dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:06.047762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-7ec69a85-c513-4c11-a962-1c1082836dcf None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:06.048943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7ec69a85-c513-4c11-a962-1c1082836dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:06.115529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 543/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:06.140274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebbc16-cd34-4b05-baa8-a147c2a68245 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:06.240540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebbc16-cd34-4b05-baa8-a147c2a68245 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:06.273519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df442a-aff1-41f4-a7d8-4250c02136d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:06.274329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df442a-aff1-41f4-a7d8-4250c02136d9 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:06.274604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df442a-aff1-41f4-a7d8-4250c02136d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:06.274873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df442a-aff1-41f4-a7d8-4250c02136d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:06.276022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df442a-aff1-41f4-a7d8-4250c02136d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:06.277428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df442a-aff1-41f4-a7d8-4250c02136d9 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:06.279044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 566/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:37:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:06.285727 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec69a85-c513-4c11-a962-1c1082836dcf None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:06.377900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec69a85-c513-4c11-a962-1c1082836dcf None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:06.410380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2990b47-5fea-4e83-b082-63dc30863426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:06.411024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2990b47-5fea-4e83-b082-63dc30863426 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:06.411302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2990b47-5fea-4e83-b082-63dc30863426 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:06.411572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2990b47-5fea-4e83-b082-63dc30863426 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:06.412263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2990b47-5fea-4e83-b082-63dc30863426 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:06.413699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2990b47-5fea-4e83-b082-63dc30863426 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:06.531431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 544/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:37:06 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:37:08.873798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33e630-3d1b-4673-9170-606b920ed5fe None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:08.874231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33e630-3d1b-4673-9170-606b920ed5fe None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:08.874375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33e630-3d1b-4673-9170-606b920ed5fe None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:08.876146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 567/1111] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:08.882266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977ecf3-8eb3-498d-a3dc-dcaf202588e1 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:08.882678 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977ecf3-8eb3-498d-a3dc-dcaf202588e1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:08.882817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977ecf3-8eb3-498d-a3dc-dcaf202588e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:08.899787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6977ecf3-8eb3-498d-a3dc-dcaf202588e1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:08.900963 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6977ecf3-8eb3-498d-a3dc-dcaf202588e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:08.963860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 545/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:08.986347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33e630-3d1b-4673-9170-606b920ed5fe None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:09.080480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33e630-3d1b-4673-9170-606b920ed5fe None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:09.113376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c062f2-d542-409e-9a84-1a482dbe6747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:09.114178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c062f2-d542-409e-9a84-1a482dbe6747 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:09.114454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c062f2-d542-409e-9a84-1a482dbe6747 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:09.114721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c062f2-d542-409e-9a84-1a482dbe6747 None admin] PATH_INFO: `/v3/roles/e83d49af62db4f4aa2dcadb10a82bfdc` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:09.116162 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c062f2-d542-409e-9a84-1a482dbe6747 None admin] RBAC: Authorizing `identity:get_role(role_id=e83d49af62db4f4aa2dcadb10a82bfdc)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:09.117505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c062f2-d542-409e-9a84-1a482dbe6747 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:09.118856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 568/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:08 2022] GET /identity/v3/roles/e83d49af62db4f4aa2dcadb10a82bfdc => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:09.124305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977ecf3-8eb3-498d-a3dc-dcaf202588e1 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:09.216697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977ecf3-8eb3-498d-a3dc-dcaf202588e1 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:09.248652 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f17c39-9825-4d21-a24c-a559744e499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:09.249500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f17c39-9825-4d21-a24c-a559744e499f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:09.249782 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f17c39-9825-4d21-a24c-a559744e499f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:09.250082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f17c39-9825-4d21-a24c-a559744e499f None admin] PATH_INFO: `/v3/users/97fa7e8399cf481c9409bbd3e08d5dee` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:09.262672 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f17c39-9825-4d21-a24c-a559744e499f None admin] RBAC: Authorizing `identity:get_user(user_id=97fa7e8399cf481c9409bbd3e08d5dee)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:09.264094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f17c39-9825-4d21-a24c-a559744e499f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:09.265689 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 546/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:09 2022] GET /identity/v3/users/97fa7e8399cf481c9409bbd3e08d5dee => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:09.271867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c062f2-d542-409e-9a84-1a482dbe6747 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:09.365490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c062f2-d542-409e-9a84-1a482dbe6747 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:09.398496 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283bb7f-f1bc-4e7e-97cd-b8937da68010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:09.399124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283bb7f-f1bc-4e7e-97cd-b8937da68010 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:09.399404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283bb7f-f1bc-4e7e-97cd-b8937da68010 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:09.399678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283bb7f-f1bc-4e7e-97cd-b8937da68010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:09.461899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283bb7f-f1bc-4e7e-97cd-b8937da68010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:09.463439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283bb7f-f1bc-4e7e-97cd-b8937da68010 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:09.554346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 569/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:37:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:37:09.560094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f17c39-9825-4d21-a24c-a559744e499f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:09.653410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f17c39-9825-4d21-a24c-a559744e499f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:09.684162 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e830f-4827-47ab-b127-c4dc3d00d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:09.684980 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e830f-4827-47ab-b127-c4dc3d00d890 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:09.685255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e830f-4827-47ab-b127-c4dc3d00d890 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:09.685521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e830f-4827-47ab-b127-c4dc3d00d890 None admin] PATH_INFO: `/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:09.686678 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e830f-4827-47ab-b127-c4dc3d00d890 None admin] RBAC: Authorizing `identity:get_project(project_id=2b2d49c1b00547de99f4e3b38e9ec68a)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:09.688080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e830f-4827-47ab-b127-c4dc3d00d890 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:09.689715 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 547/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:37:09 2022] GET /identity/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:09.696384 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283bb7f-f1bc-4e7e-97cd-b8937da68010 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:09.789157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283bb7f-f1bc-4e7e-97cd-b8937da68010 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:09.820808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d56c63-56d7-48f8-a1b2-9c1f89fa4c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:09.821451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d56c63-56d7-48f8-a1b2-9c1f89fa4c94 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:09.821728 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d56c63-56d7-48f8-a1b2-9c1f89fa4c94 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:09.822014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d56c63-56d7-48f8-a1b2-9c1f89fa4c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:09.822836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d56c63-56d7-48f8-a1b2-9c1f89fa4c94 None admin] RBAC: Adding query filter params (role.id=e83d49af62db4f4aa2dcadb10a82bfdc, scope.project.id=2b2d49c1b00547de99f4e3b38e9ec68a, user.id=97fa7e8399cf481c9409bbd3e08d5dee) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:09.823143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d56c63-56d7-48f8-a1b2-9c1f89fa4c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:09.824547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d56c63-56d7-48f8-a1b2-9c1f89fa4c94 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:09.829778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 570/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:37:09 2022] GET /identity/v3/role_assignments?user.id=97fa7e8399cf481c9409bbd3e08d5dee&scope.project.id=2b2d49c1b00547de99f4e3b38e9ec68a&role.id=e83d49af62db4f4aa2dcadb10a82bfdc => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:12.074442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf64a6-c150-4cfc-a303-abb7cda564ba None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:12.074959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf64a6-c150-4cfc-a303-abb7cda564ba None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:12.074959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf64a6-c150-4cfc-a303-abb7cda564ba None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:12.076748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 548/1118] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:12.082074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad10ffa-6e30-46e7-ae98-a1966acc0c63 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:12.082446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad10ffa-6e30-46e7-ae98-a1966acc0c63 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:12.082626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad10ffa-6e30-46e7-ae98-a1966acc0c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:12.099399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-3ad10ffa-6e30-46e7-ae98-a1966acc0c63 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:12.100573 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3ad10ffa-6e30-46e7-ae98-a1966acc0c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:12.164242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 571/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:37:12.186281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf64a6-c150-4cfc-a303-abb7cda564ba None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:12.282785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf64a6-c150-4cfc-a303-abb7cda564ba None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:12.315396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d331c0-2922-435b-9f2f-3e6f3164be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:12.316235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d331c0-2922-435b-9f2f-3e6f3164be61 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:12.316510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d331c0-2922-435b-9f2f-3e6f3164be61 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:12.316779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d331c0-2922-435b-9f2f-3e6f3164be61 None admin] PATH_INFO: `/v3/roles/e83d49af62db4f4aa2dcadb10a82bfdc` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:12.318255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d331c0-2922-435b-9f2f-3e6f3164be61 None admin] RBAC: Authorizing `identity:get_role(role_id=e83d49af62db4f4aa2dcadb10a82bfdc)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:12.319612 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d331c0-2922-435b-9f2f-3e6f3164be61 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:12.320946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 549/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:12 2022] GET /identity/v3/roles/e83d49af62db4f4aa2dcadb10a82bfdc => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:12.326743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad10ffa-6e30-46e7-ae98-a1966acc0c63 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:12.422976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad10ffa-6e30-46e7-ae98-a1966acc0c63 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:12.454674 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7d8e6-ea7b-4922-a502-9cce5ce3713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:12.456503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7d8e6-ea7b-4922-a502-9cce5ce3713c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:12.456811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7d8e6-ea7b-4922-a502-9cce5ce3713c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:12.457096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7d8e6-ea7b-4922-a502-9cce5ce3713c None admin] PATH_INFO: `/v3/users/97fa7e8399cf481c9409bbd3e08d5dee` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:12.458277 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7d8e6-ea7b-4922-a502-9cce5ce3713c None admin] RBAC: Authorizing `identity:get_user(user_id=97fa7e8399cf481c9409bbd3e08d5dee)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:12.459701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7d8e6-ea7b-4922-a502-9cce5ce3713c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:12.461301 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 572/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:12 2022] GET /identity/v3/users/97fa7e8399cf481c9409bbd3e08d5dee => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:12.467020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d331c0-2922-435b-9f2f-3e6f3164be61 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:12.560385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d331c0-2922-435b-9f2f-3e6f3164be61 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:12.592838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68928865-2531-44fa-8607-f6445bae6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:12.593682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928865-2531-44fa-8607-f6445bae6888 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:12.593959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928865-2531-44fa-8607-f6445bae6888 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:12.594262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928865-2531-44fa-8607-f6445bae6888 None admin] PATH_INFO: `/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:12.595423 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68928865-2531-44fa-8607-f6445bae6888 None admin] RBAC: Authorizing `identity:get_project(project_id=2b2d49c1b00547de99f4e3b38e9ec68a)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:12.596918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68928865-2531-44fa-8607-f6445bae6888 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:12.598613 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 550/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:37:12 2022] GET /identity/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:37:12.604348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7d8e6-ea7b-4922-a502-9cce5ce3713c None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:12.696997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7d8e6-ea7b-4922-a502-9cce5ce3713c None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:12.728972 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181a620-5c93-437a-92c0-bd3f4b2abff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:12.729830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a620-5c93-437a-92c0-bd3f4b2abff4 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:12.730136 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a620-5c93-437a-92c0-bd3f4b2abff4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:12.730408 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181a620-5c93-437a-92c0-bd3f4b2abff4 None admin] PATH_INFO: `/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a/users/97fa7e8399cf481c9409bbd3e08d5dee/roles/e83d49af62db4f4aa2dcadb10a82bfdc` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:12.732622 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181a620-5c93-437a-92c0-bd3f4b2abff4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b2d49c1b00547de99f4e3b38e9ec68a, user_id=97fa7e8399cf481c9409bbd3e08d5dee, role_id=e83d49af62db4f4aa2dcadb10a82bfdc)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:12.734056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181a620-5c93-437a-92c0-bd3f4b2abff4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:12.810586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 573/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:37:12 2022] PUT /identity/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a/users/97fa7e8399cf481c9409bbd3e08d5dee/roles/e83d49af62db4f4aa2dcadb10a82bfdc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:37:15.100666 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9aa8b-f642-44ee-9603-e53029ec0246 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:15.101186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9aa8b-f642-44ee-9603-e53029ec0246 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:15.101186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9aa8b-f642-44ee-9603-e53029ec0246 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:15.103014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 551/1124] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:15.108170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f163-6cae-44f6-a48d-b81c4a54b4dd None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:15.108595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f163-6cae-44f6-a48d-b81c4a54b4dd None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:15.108696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9f163-6cae-44f6-a48d-b81c4a54b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:15.125869 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-9ce9f163-6cae-44f6-a48d-b81c4a54b4dd None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:15.127080 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9ce9f163-6cae-44f6-a48d-b81c4a54b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:15.189635 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 574/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:15.213097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9aa8b-f642-44ee-9603-e53029ec0246 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:15.310347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9aa8b-f642-44ee-9603-e53029ec0246 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:15.342181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dd1d8-ac9d-459b-a2b9-58404db99f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:15.343017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dd1d8-ac9d-459b-a2b9-58404db99f5e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:15.343296 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dd1d8-ac9d-459b-a2b9-58404db99f5e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:15.343570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dd1d8-ac9d-459b-a2b9-58404db99f5e None admin] PATH_INFO: `/v3/roles/e83d49af62db4f4aa2dcadb10a82bfdc` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:15.345013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dd1d8-ac9d-459b-a2b9-58404db99f5e None admin] RBAC: Authorizing `identity:get_role(role_id=e83d49af62db4f4aa2dcadb10a82bfdc)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:15.347168 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dd1d8-ac9d-459b-a2b9-58404db99f5e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:15.348522 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 552/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:15 2022] GET /identity/v3/roles/e83d49af62db4f4aa2dcadb10a82bfdc => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:15.354281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9f163-6cae-44f6-a48d-b81c4a54b4dd None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:15.446374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9f163-6cae-44f6-a48d-b81c4a54b4dd None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:15.478608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1e215-b1d1-4081-bc9b-c542c86c05b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:15.479465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1e215-b1d1-4081-bc9b-c542c86c05b3 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:15.479745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1e215-b1d1-4081-bc9b-c542c86c05b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:15.480018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1e215-b1d1-4081-bc9b-c542c86c05b3 None admin] PATH_INFO: `/v3/users/97fa7e8399cf481c9409bbd3e08d5dee` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:15.481201 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1e215-b1d1-4081-bc9b-c542c86c05b3 None admin] RBAC: Authorizing `identity:get_user(user_id=97fa7e8399cf481c9409bbd3e08d5dee)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:15.482656 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1e215-b1d1-4081-bc9b-c542c86c05b3 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:15.484264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 575/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:15 2022] GET /identity/v3/users/97fa7e8399cf481c9409bbd3e08d5dee => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:15.489977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dd1d8-ac9d-459b-a2b9-58404db99f5e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:15.583946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dd1d8-ac9d-459b-a2b9-58404db99f5e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:15.615171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f523ac3-544c-4168-8198-6d5cffb0370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:15.615797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f523ac3-544c-4168-8198-6d5cffb0370b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:15.616076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f523ac3-544c-4168-8198-6d5cffb0370b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:15.616348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f523ac3-544c-4168-8198-6d5cffb0370b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:15.678971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f523ac3-544c-4168-8198-6d5cffb0370b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:15.680395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f523ac3-544c-4168-8198-6d5cffb0370b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:15.776893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 553/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:37:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:37:15.782720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1e215-b1d1-4081-bc9b-c542c86c05b3 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:15.876335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1e215-b1d1-4081-bc9b-c542c86c05b3 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:15.908511 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b5f11-65ba-4c57-84e1-72cce6ff65a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:15.909351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5f11-65ba-4c57-84e1-72cce6ff65a9 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:15.909632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5f11-65ba-4c57-84e1-72cce6ff65a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:15.909905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b5f11-65ba-4c57-84e1-72cce6ff65a9 None admin] PATH_INFO: `/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:15.911102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b5f11-65ba-4c57-84e1-72cce6ff65a9 None admin] RBAC: Authorizing `identity:get_project(project_id=2b2d49c1b00547de99f4e3b38e9ec68a)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:15.912508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b5f11-65ba-4c57-84e1-72cce6ff65a9 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:15.914205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 576/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:37:15 2022] GET /identity/v3/projects/2b2d49c1b00547de99f4e3b38e9ec68a => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:15.920166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f523ac3-544c-4168-8198-6d5cffb0370b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:16.012481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f523ac3-544c-4168-8198-6d5cffb0370b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:16.043663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abe3c0-d976-4ad9-861e-f1c6911f2402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:16.044243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abe3c0-d976-4ad9-861e-f1c6911f2402 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:16.044523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abe3c0-d976-4ad9-861e-f1c6911f2402 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:16.044797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abe3c0-d976-4ad9-861e-f1c6911f2402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:16.045610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abe3c0-d976-4ad9-861e-f1c6911f2402 None admin] RBAC: Adding query filter params (role.id=e83d49af62db4f4aa2dcadb10a82bfdc, scope.project.id=2b2d49c1b00547de99f4e3b38e9ec68a, user.id=97fa7e8399cf481c9409bbd3e08d5dee) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:16.045918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abe3c0-d976-4ad9-861e-f1c6911f2402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:16.047351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abe3c0-d976-4ad9-861e-f1c6911f2402 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:16.053381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 554/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:37:15 2022] GET /identity/v3/role_assignments?user.id=97fa7e8399cf481c9409bbd3e08d5dee&scope.project.id=2b2d49c1b00547de99f4e3b38e9ec68a&role.id=e83d49af62db4f4aa2dcadb10a82bfdc => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:18.341852 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb213872-52cc-42ab-8c1c-5531859490fc None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:18.342424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb213872-52cc-42ab-8c1c-5531859490fc None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:18.342424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb213872-52cc-42ab-8c1c-5531859490fc None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:18.344218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 577/1131] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:18.349485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364101bc-5562-4f67-a168-e9e60be5acfc None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:18.349903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364101bc-5562-4f67-a168-e9e60be5acfc None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:18.350035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364101bc-5562-4f67-a168-e9e60be5acfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:18.367012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-364101bc-5562-4f67-a168-e9e60be5acfc None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:18.368196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-364101bc-5562-4f67-a168-e9e60be5acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:18.431612 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 555/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:18.456535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb213872-52cc-42ab-8c1c-5531859490fc None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:18.551062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb213872-52cc-42ab-8c1c-5531859490fc None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:18.583051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430378c7-1902-4deb-bb56-aae57da44b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:18.583822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430378c7-1902-4deb-bb56-aae57da44b8b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:18.584097 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430378c7-1902-4deb-bb56-aae57da44b8b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:18.584364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430378c7-1902-4deb-bb56-aae57da44b8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:18.585507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430378c7-1902-4deb-bb56-aae57da44b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:18.586945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430378c7-1902-4deb-bb56-aae57da44b8b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:18.588504 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 578/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:37:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:18.594275 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364101bc-5562-4f67-a168-e9e60be5acfc None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:18.684946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364101bc-5562-4f67-a168-e9e60be5acfc None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:18.716869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca25598-0536-40ba-a2c8-f1debafba109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:18.717509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca25598-0536-40ba-a2c8-f1debafba109 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:18.717788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca25598-0536-40ba-a2c8-f1debafba109 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:18.718089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca25598-0536-40ba-a2c8-f1debafba109 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:18.718778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca25598-0536-40ba-a2c8-f1debafba109 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:18.720196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca25598-0536-40ba-a2c8-f1debafba109 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:18.818050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 556/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:37:18 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:37:21.129278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7721e1-fc8b-4980-824e-3ceec7b68893 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:21.130105 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7721e1-fc8b-4980-824e-3ceec7b68893 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:21.130105 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7721e1-fc8b-4980-824e-3ceec7b68893 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:21.131783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 579/1135] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:21.136972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab7e3-206b-4c8e-afc4-9078608edd0f None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:21.137357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab7e3-206b-4c8e-afc4-9078608edd0f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:21.137529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab7e3-206b-4c8e-afc4-9078608edd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:21.154375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-624ab7e3-206b-4c8e-afc4-9078608edd0f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:21.155540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-624ab7e3-206b-4c8e-afc4-9078608edd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:21.217547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 557/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:21.242772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7721e1-fc8b-4980-824e-3ceec7b68893 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:21.337806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7721e1-fc8b-4980-824e-3ceec7b68893 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:21.369810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd1eae-3cc3-435a-ac57-4302ee146415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:21.370630 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1eae-3cc3-435a-ac57-4302ee146415 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:21.370909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1eae-3cc3-435a-ac57-4302ee146415 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:21.371178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd1eae-3cc3-435a-ac57-4302ee146415 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:21.372326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd1eae-3cc3-435a-ac57-4302ee146415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:21.373722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd1eae-3cc3-435a-ac57-4302ee146415 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:21.375318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 580/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:37:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:21.381218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab7e3-206b-4c8e-afc4-9078608edd0f None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:21.476692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab7e3-206b-4c8e-afc4-9078608edd0f None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:21.508776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e79e6b-3b0e-469b-a4dc-bfd12964d704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:21.509436 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79e6b-3b0e-469b-a4dc-bfd12964d704 None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:21.509714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79e6b-3b0e-469b-a4dc-bfd12964d704 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:21.510010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79e6b-3b0e-469b-a4dc-bfd12964d704 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:21.510707 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e79e6b-3b0e-469b-a4dc-bfd12964d704 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:21.512132 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e79e6b-3b0e-469b-a4dc-bfd12964d704 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:21.603781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 558/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:37:21 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:37:23.921597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94540508-7b80-4e90-bedc-1874453bcd19 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:23.922146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94540508-7b80-4e90-bedc-1874453bcd19 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:23.922236 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94540508-7b80-4e90-bedc-1874453bcd19 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:23.924029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 581/1139] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:23.929347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133fd9c-eb41-4aee-91a7-8071bab4a441 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:23.929762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133fd9c-eb41-4aee-91a7-8071bab4a441 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:23.929893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133fd9c-eb41-4aee-91a7-8071bab4a441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:23.946954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6133fd9c-eb41-4aee-91a7-8071bab4a441 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:23.948120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6133fd9c-eb41-4aee-91a7-8071bab4a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:24.010714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 559/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:24.034294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94540508-7b80-4e90-bedc-1874453bcd19 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:24.138458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94540508-7b80-4e90-bedc-1874453bcd19 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:24.170785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b906a-7ff2-49f2-8446-b2d718a3be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:24.171565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b906a-7ff2-49f2-8446-b2d718a3be7e None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:24.171846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b906a-7ff2-49f2-8446-b2d718a3be7e None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:24.172120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b906a-7ff2-49f2-8446-b2d718a3be7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:24.182721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b906a-7ff2-49f2-8446-b2d718a3be7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:37:24.190703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-ab8b906a-7ff2-49f2-8446-b2d718a3be7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:37:24.191880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 582/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:37:24.198056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133fd9c-eb41-4aee-91a7-8071bab4a441 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:24.297853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133fd9c-eb41-4aee-91a7-8071bab4a441 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:24.331453 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702f0a-e62b-48a8-9c34-9cecf296f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:24.332107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702f0a-e62b-48a8-9c34-9cecf296f586 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:24.332389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702f0a-e62b-48a8-9c34-9cecf296f586 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:24.332663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba702f0a-e62b-48a8-9c34-9cecf296f586 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:24.333403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702f0a-e62b-48a8-9c34-9cecf296f586 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:24.333706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702f0a-e62b-48a8-9c34-9cecf296f586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:24.335091 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba702f0a-e62b-48a8-9c34-9cecf296f586 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:24.342758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 560/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:24.348466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b906a-7ff2-49f2-8446-b2d718a3be7e None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:24.442697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b906a-7ff2-49f2-8446-b2d718a3be7e None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:24.473887 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea95e68-0211-4bd1-a331-8f83c552d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:24.474785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95e68-0211-4bd1-a331-8f83c552d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:24.475062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95e68-0211-4bd1-a331-8f83c552d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:24.475329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea95e68-0211-4bd1-a331-8f83c552d6f8 None admin] PATH_INFO: `/v3/users/38376145a1f44ba480f313b82051f7ea` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:24.488127 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea95e68-0211-4bd1-a331-8f83c552d6f8 None admin] RBAC: Authorizing `identity:get_user(user_id=38376145a1f44ba480f313b82051f7ea)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:24.489565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea95e68-0211-4bd1-a331-8f83c552d6f8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:24.491218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 583/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:24 2022] GET /identity/v3/users/38376145a1f44ba480f313b82051f7ea => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:24.496896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702f0a-e62b-48a8-9c34-9cecf296f586 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:24.592439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba702f0a-e62b-48a8-9c34-9cecf296f586 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:24.624136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2735f3-62f3-41f3-83a6-ea941f3f4d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:24.624761 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2735f3-62f3-41f3-83a6-ea941f3f4d11 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:24.625036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2735f3-62f3-41f3-83a6-ea941f3f4d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:24.625302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2735f3-62f3-41f3-83a6-ea941f3f4d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:24.687161 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2735f3-62f3-41f3-83a6-ea941f3f4d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:24.688585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2735f3-62f3-41f3-83a6-ea941f3f4d11 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:24.779026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 561/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:37:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:37:24.784760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea95e68-0211-4bd1-a331-8f83c552d6f8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:24.877778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea95e68-0211-4bd1-a331-8f83c552d6f8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:24.909137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b60aa-2a92-403f-9f15-6ce138e79463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:24.909975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b60aa-2a92-403f-9f15-6ce138e79463 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:24.910282 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b60aa-2a92-403f-9f15-6ce138e79463 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:24.910556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b60aa-2a92-403f-9f15-6ce138e79463 None admin] PATH_INFO: `/v3/projects/aff7bbc92f094f2c8f3bbeb0c2bc0b24` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:24.911707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b60aa-2a92-403f-9f15-6ce138e79463 None admin] RBAC: Authorizing `identity:get_project(project_id=aff7bbc92f094f2c8f3bbeb0c2bc0b24)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:24.913116 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b60aa-2a92-403f-9f15-6ce138e79463 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:24.914814 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 584/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:37:24 2022] GET /identity/v3/projects/aff7bbc92f094f2c8f3bbeb0c2bc0b24 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:24.920901 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2735f3-62f3-41f3-83a6-ea941f3f4d11 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:25.013173 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2735f3-62f3-41f3-83a6-ea941f3f4d11 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:25.043858 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613746ad-59dd-44f2-95c5-b3f64153d431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:25.044437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613746ad-59dd-44f2-95c5-b3f64153d431 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:25.044713 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613746ad-59dd-44f2-95c5-b3f64153d431 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:25.044982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613746ad-59dd-44f2-95c5-b3f64153d431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:25.045784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613746ad-59dd-44f2-95c5-b3f64153d431 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=aff7bbc92f094f2c8f3bbeb0c2bc0b24, user.id=38376145a1f44ba480f313b82051f7ea) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:25.046116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613746ad-59dd-44f2-95c5-b3f64153d431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:25.047506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613746ad-59dd-44f2-95c5-b3f64153d431 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:25.053109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 562/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:37:24 2022] GET /identity/v3/role_assignments?user.id=38376145a1f44ba480f313b82051f7ea&scope.project.id=aff7bbc92f094f2c8f3bbeb0c2bc0b24&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:27.288949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc447b-9ced-4cfa-b683-7b5f4c793a58 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:27.289550 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc447b-9ced-4cfa-b683-7b5f4c793a58 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:27.289550 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc447b-9ced-4cfa-b683-7b5f4c793a58 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:27.291196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 585/1147] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:27.296253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e947a8c-3df9-46cb-8e7e-ba134f23553d None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:27.296645 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e947a8c-3df9-46cb-8e7e-ba134f23553d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:27.296789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e947a8c-3df9-46cb-8e7e-ba134f23553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:27.313522 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1e947a8c-3df9-46cb-8e7e-ba134f23553d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:27.315391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1e947a8c-3df9-46cb-8e7e-ba134f23553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:27.376125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 563/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:27.399767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc447b-9ced-4cfa-b683-7b5f4c793a58 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:27.494174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc447b-9ced-4cfa-b683-7b5f4c793a58 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:27.525832 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cfa8b-ee4f-4d28-b4e2-eb3c4107ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:27.526628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cfa8b-ee4f-4d28-b4e2-eb3c4107ba91 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:27.526910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cfa8b-ee4f-4d28-b4e2-eb3c4107ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:27.527181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cfa8b-ee4f-4d28-b4e2-eb3c4107ba91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:27.537227 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cfa8b-ee4f-4d28-b4e2-eb3c4107ba91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:37:27.544175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-e12cfa8b-ee4f-4d28-b4e2-eb3c4107ba91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:37:27.545267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 586/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:37:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:37:27.551189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e947a8c-3df9-46cb-8e7e-ba134f23553d None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:27.644120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e947a8c-3df9-46cb-8e7e-ba134f23553d None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:27.676230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a22642-297b-46e3-b343-52d5d674774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:27.676874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a22642-297b-46e3-b343-52d5d674774f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:27.677149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a22642-297b-46e3-b343-52d5d674774f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:27.677419 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a22642-297b-46e3-b343-52d5d674774f None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:27.678172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a22642-297b-46e3-b343-52d5d674774f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:27.678471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a22642-297b-46e3-b343-52d5d674774f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:27.679810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a22642-297b-46e3-b343-52d5d674774f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:27.687350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 564/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:37:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:27.693174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cfa8b-ee4f-4d28-b4e2-eb3c4107ba91 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:27.786445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cfa8b-ee4f-4d28-b4e2-eb3c4107ba91 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:27.817523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a8998-ef0b-49fe-b761-c5455d7047ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:27.818418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8998-ef0b-49fe-b761-c5455d7047ae None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:27.818701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8998-ef0b-49fe-b761-c5455d7047ae None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:27.818972 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a8998-ef0b-49fe-b761-c5455d7047ae None admin] PATH_INFO: `/v3/users/38376145a1f44ba480f313b82051f7ea` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:27.820151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a8998-ef0b-49fe-b761-c5455d7047ae None admin] RBAC: Authorizing `identity:get_user(user_id=38376145a1f44ba480f313b82051f7ea)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:27.821564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a8998-ef0b-49fe-b761-c5455d7047ae None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:27.823185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 587/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:27 2022] GET /identity/v3/users/38376145a1f44ba480f313b82051f7ea => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:27.828742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a22642-297b-46e3-b343-52d5d674774f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:27.926983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a22642-297b-46e3-b343-52d5d674774f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:27.958315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944c9dc-4391-418a-98eb-6aa522771998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:27.959151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c9dc-4391-418a-98eb-6aa522771998 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:27.959424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c9dc-4391-418a-98eb-6aa522771998 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:27.959695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c9dc-4391-418a-98eb-6aa522771998 None admin] PATH_INFO: `/v3/projects/aff7bbc92f094f2c8f3bbeb0c2bc0b24` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:27.960837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944c9dc-4391-418a-98eb-6aa522771998 None admin] RBAC: Authorizing `identity:get_project(project_id=aff7bbc92f094f2c8f3bbeb0c2bc0b24)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:27.962262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944c9dc-4391-418a-98eb-6aa522771998 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:27.963911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 565/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:37:27 2022] GET /identity/v3/projects/aff7bbc92f094f2c8f3bbeb0c2bc0b24 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:27.969712 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a8998-ef0b-49fe-b761-c5455d7047ae None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:28.061874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a8998-ef0b-49fe-b761-c5455d7047ae None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:28.092922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adf6ec-fcc4-4b22-ba7c-76b67550ab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:28.093721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adf6ec-fcc4-4b22-ba7c-76b67550ab9f None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:28.094019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adf6ec-fcc4-4b22-ba7c-76b67550ab9f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:28.094290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adf6ec-fcc4-4b22-ba7c-76b67550ab9f None admin] PATH_INFO: `/v3/projects/aff7bbc92f094f2c8f3bbeb0c2bc0b24/users/38376145a1f44ba480f313b82051f7ea/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:28.096401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adf6ec-fcc4-4b22-ba7c-76b67550ab9f None admin] RBAC: Authorizing `identity:create_grant(project_id=aff7bbc92f094f2c8f3bbeb0c2bc0b24, user_id=38376145a1f44ba480f313b82051f7ea, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:28.097793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adf6ec-fcc4-4b22-ba7c-76b67550ab9f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:28.193486 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 588/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:37:27 2022] PUT /identity/v3/projects/aff7bbc92f094f2c8f3bbeb0c2bc0b24/users/38376145a1f44ba480f313b82051f7ea/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:37:30.435379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e852-36d3-43fe-831c-13ff1a18fdb7 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:30.435914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e852-36d3-43fe-831c-13ff1a18fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:30.435914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e852-36d3-43fe-831c-13ff1a18fdb7 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:30.437697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 566/1154] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:30.443571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55ed4-0ff4-4d1d-9a0f-c08905574048 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:30.443942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55ed4-0ff4-4d1d-9a0f-c08905574048 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:30.444114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55ed4-0ff4-4d1d-9a0f-c08905574048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:30.460406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-7fa55ed4-0ff4-4d1d-9a0f-c08905574048 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:30.461562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7fa55ed4-0ff4-4d1d-9a0f-c08905574048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:30.527102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 589/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:37:30.555267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35e852-36d3-43fe-831c-13ff1a18fdb7 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:30.650549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35e852-36d3-43fe-831c-13ff1a18fdb7 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:30.682673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeff32-b2ee-4a47-bb73-8d5abe9cf733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:30.683448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeff32-b2ee-4a47-bb73-8d5abe9cf733 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:30.683728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeff32-b2ee-4a47-bb73-8d5abe9cf733 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:30.684001 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeff32-b2ee-4a47-bb73-8d5abe9cf733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:30.694251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aeff32-b2ee-4a47-bb73-8d5abe9cf733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:37:30.701098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-f2aeff32-b2ee-4a47-bb73-8d5abe9cf733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:37:30.702282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 567/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:37:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:37:30.708448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55ed4-0ff4-4d1d-9a0f-c08905574048 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:30.801174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55ed4-0ff4-4d1d-9a0f-c08905574048 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:30.834057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f163f-85db-49f9-993d-1a3008c81b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:30.834714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f163f-85db-49f9-993d-1a3008c81b69 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:30.835014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f163f-85db-49f9-993d-1a3008c81b69 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:30.835288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f163f-85db-49f9-993d-1a3008c81b69 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:30.836026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f163f-85db-49f9-993d-1a3008c81b69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:30.836327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f163f-85db-49f9-993d-1a3008c81b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:30.837674 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f163f-85db-49f9-993d-1a3008c81b69 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:30.845410 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 590/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:30.851346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeff32-b2ee-4a47-bb73-8d5abe9cf733 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:30.946782 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeff32-b2ee-4a47-bb73-8d5abe9cf733 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:30.978270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ccb1b-25d2-4bf6-ae89-ad1050b868dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:30.979118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ccb1b-25d2-4bf6-ae89-ad1050b868dc None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:30.979397 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ccb1b-25d2-4bf6-ae89-ad1050b868dc None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:30.979668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ccb1b-25d2-4bf6-ae89-ad1050b868dc None admin] PATH_INFO: `/v3/users/38376145a1f44ba480f313b82051f7ea` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:30.980828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ccb1b-25d2-4bf6-ae89-ad1050b868dc None admin] RBAC: Authorizing `identity:get_user(user_id=38376145a1f44ba480f313b82051f7ea)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:30.982278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ccb1b-25d2-4bf6-ae89-ad1050b868dc None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:30.983875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 568/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:30 2022] GET /identity/v3/users/38376145a1f44ba480f313b82051f7ea => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:30.990324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f163f-85db-49f9-993d-1a3008c81b69 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:31.084805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f163f-85db-49f9-993d-1a3008c81b69 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:31.115944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be0ed0-acbd-4149-8788-30718d353cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:31.116573 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0ed0-acbd-4149-8788-30718d353cb3 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:31.116853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0ed0-acbd-4149-8788-30718d353cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:31.117125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0ed0-acbd-4149-8788-30718d353cb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:31.181700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be0ed0-acbd-4149-8788-30718d353cb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:31.183180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be0ed0-acbd-4149-8788-30718d353cb3 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:31.274837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 591/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:37:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:37:31.280716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ccb1b-25d2-4bf6-ae89-ad1050b868dc None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:31.375672 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ccb1b-25d2-4bf6-ae89-ad1050b868dc None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:31.408306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344686e-4f66-49e5-9ebd-fa2e66de2052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:31.409144 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344686e-4f66-49e5-9ebd-fa2e66de2052 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:31.409420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344686e-4f66-49e5-9ebd-fa2e66de2052 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:31.409688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344686e-4f66-49e5-9ebd-fa2e66de2052 None admin] PATH_INFO: `/v3/projects/aff7bbc92f094f2c8f3bbeb0c2bc0b24` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:31.410864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344686e-4f66-49e5-9ebd-fa2e66de2052 None admin] RBAC: Authorizing `identity:get_project(project_id=aff7bbc92f094f2c8f3bbeb0c2bc0b24)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:31.412282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344686e-4f66-49e5-9ebd-fa2e66de2052 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:31.413947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 569/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:37:31 2022] GET /identity/v3/projects/aff7bbc92f094f2c8f3bbeb0c2bc0b24 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:31.420005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be0ed0-acbd-4149-8788-30718d353cb3 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:31.512871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be0ed0-acbd-4149-8788-30718d353cb3 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:31.544644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d02458-4a8e-4625-8e2a-fe453563d1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:31.545224 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d02458-4a8e-4625-8e2a-fe453563d1ca None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:31.545504 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d02458-4a8e-4625-8e2a-fe453563d1ca None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:31.545778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d02458-4a8e-4625-8e2a-fe453563d1ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:31.546626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d02458-4a8e-4625-8e2a-fe453563d1ca None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=aff7bbc92f094f2c8f3bbeb0c2bc0b24, user.id=38376145a1f44ba480f313b82051f7ea) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:31.546933 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d02458-4a8e-4625-8e2a-fe453563d1ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:31.548453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d02458-4a8e-4625-8e2a-fe453563d1ca None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:31.553905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 592/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:37:31 2022] GET /identity/v3/role_assignments?user.id=38376145a1f44ba480f313b82051f7ea&scope.project.id=aff7bbc92f094f2c8f3bbeb0c2bc0b24&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:33.846225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315afdfc-059b-4394-b05d-09dbfc0cbf14 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:33.846750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315afdfc-059b-4394-b05d-09dbfc0cbf14 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:33.846750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315afdfc-059b-4394-b05d-09dbfc0cbf14 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:33.848535 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 570/1162] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:33.853840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f04643-071d-4632-a1bc-7392e49a6885 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:33.854278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f04643-071d-4632-a1bc-7392e49a6885 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:33.854416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f04643-071d-4632-a1bc-7392e49a6885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:33.871304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-51f04643-071d-4632-a1bc-7392e49a6885 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:33.872494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-51f04643-071d-4632-a1bc-7392e49a6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:33.935062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 593/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:33.957937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315afdfc-059b-4394-b05d-09dbfc0cbf14 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:34.052126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315afdfc-059b-4394-b05d-09dbfc0cbf14 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:34.083395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f38b5-a377-4563-bc7c-44ab73cc1324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:34.084014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f38b5-a377-4563-bc7c-44ab73cc1324 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:34.084289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f38b5-a377-4563-bc7c-44ab73cc1324 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:34.084557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f38b5-a377-4563-bc7c-44ab73cc1324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:34.146320 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f38b5-a377-4563-bc7c-44ab73cc1324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:34.147678 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f38b5-a377-4563-bc7c-44ab73cc1324 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:34.238362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 571/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:37:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:37:34.244051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f04643-071d-4632-a1bc-7392e49a6885 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:34.336077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f04643-071d-4632-a1bc-7392e49a6885 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:34.367701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c903831-0a72-4137-9a2e-70ece658072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:34.368480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c903831-0a72-4137-9a2e-70ece658072a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:34.368752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c903831-0a72-4137-9a2e-70ece658072a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:34.369016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c903831-0a72-4137-9a2e-70ece658072a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:34.375364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c903831-0a72-4137-9a2e-70ece658072a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:34.376907 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c903831-0a72-4137-9a2e-70ece658072a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:34.390787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-5c903831-0a72-4137-9a2e-70ece658072a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 28 21:37:34.391945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 594/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Feb 28 21:37:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:37:34.398088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f38b5-a377-4563-bc7c-44ab73cc1324 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:34.490600 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f38b5-a377-4563-bc7c-44ab73cc1324 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:34.522656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e87633-25c4-4efb-9c44-6b697d34adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:34.523293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e87633-25c4-4efb-9c44-6b697d34adee None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:34.523566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e87633-25c4-4efb-9c44-6b697d34adee None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:34.523835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e87633-25c4-4efb-9c44-6b697d34adee None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:34.524535 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e87633-25c4-4efb-9c44-6b697d34adee None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:34.524833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e87633-25c4-4efb-9c44-6b697d34adee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:34.526209 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e87633-25c4-4efb-9c44-6b697d34adee None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:34.533018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 572/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Mon Feb 28 21:37:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:36.792854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c44d-806e-45c8-a822-3c3548a556e9 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:36.793387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c44d-806e-45c8-a822-3c3548a556e9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:36.793387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c44d-806e-45c8-a822-3c3548a556e9 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:36.795181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 595/1167] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:36.800527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef292e9-1a70-406d-8342-93aa21691546 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:36.800938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef292e9-1a70-406d-8342-93aa21691546 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:36.801087 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef292e9-1a70-406d-8342-93aa21691546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:36.817937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-0ef292e9-1a70-406d-8342-93aa21691546 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:36.819143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0ef292e9-1a70-406d-8342-93aa21691546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:36.882982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 573/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:36.905535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1c44d-806e-45c8-a822-3c3548a556e9 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:37.003971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1c44d-806e-45c8-a822-3c3548a556e9 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:37.035943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340a142-5e43-4d8c-89c2-febc2b978f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:37.036587 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340a142-5e43-4d8c-89c2-febc2b978f9d None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:37.036865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340a142-5e43-4d8c-89c2-febc2b978f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:37.037136 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340a142-5e43-4d8c-89c2-febc2b978f9d None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:37.037856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340a142-5e43-4d8c-89c2-febc2b978f9d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:37.039246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340a142-5e43-4d8c-89c2-febc2b978f9d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:37.102546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 596/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Mon Feb 28 21:37:36 2022] POST /identity/v3/domains => generated 267 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:37:39.405212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e4dd7-5839-493d-8e97-42f25d542da9 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:39.405773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e4dd7-5839-493d-8e97-42f25d542da9 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:39.405773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e4dd7-5839-493d-8e97-42f25d542da9 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:39.407581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 574/1170] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:39.413468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c41d51-aabb-4728-97ee-1eb4294c273e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:39.413875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c41d51-aabb-4728-97ee-1eb4294c273e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:39.414032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c41d51-aabb-4728-97ee-1eb4294c273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:39.430593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d5c41d51-aabb-4728-97ee-1eb4294c273e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:39.431791 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d5c41d51-aabb-4728-97ee-1eb4294c273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:39.494010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 597/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:39.518621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e4dd7-5839-493d-8e97-42f25d542da9 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:39.613356 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e4dd7-5839-493d-8e97-42f25d542da9 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:39.645865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09227067-fe86-43f8-a7d7-63651548a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:39.646736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09227067-fe86-43f8-a7d7-63651548a188 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:39.647012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09227067-fe86-43f8-a7d7-63651548a188 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:39.647282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09227067-fe86-43f8-a7d7-63651548a188 None admin] PATH_INFO: `/v3/domains/8ebdb9b068f946029a58a819a463690f` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:39.657173 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09227067-fe86-43f8-a7d7-63651548a188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8ebdb9b068f946029a58a819a463690f)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:39.658600 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09227067-fe86-43f8-a7d7-63651548a188 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:39.660190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 575/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Feb 28 21:37:39 2022] GET /identity/v3/domains/8ebdb9b068f946029a58a819a463690f => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:39.665802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c41d51-aabb-4728-97ee-1eb4294c273e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:39.758853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c41d51-aabb-4728-97ee-1eb4294c273e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:39.790835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d195f-7237-4d96-a4bf-2d42884ca706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:39.791480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d195f-7237-4d96-a4bf-2d42884ca706 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:39.791758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d195f-7237-4d96-a4bf-2d42884ca706 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:39.792029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d195f-7237-4d96-a4bf-2d42884ca706 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:39.792724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d195f-7237-4d96-a4bf-2d42884ca706 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:39.794168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d195f-7237-4d96-a4bf-2d42884ca706 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:39.879578 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 598/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:37:39 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:37:42.284008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b993f-5b2c-489a-bfe8-1cec07d72314 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:42.284518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b993f-5b2c-489a-bfe8-1cec07d72314 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:42.284518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b993f-5b2c-489a-bfe8-1cec07d72314 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:42.286320 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 576/1174] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:42.291577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672a528-2f11-4cbb-97f7-0f9c752872c1 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:42.291941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672a528-2f11-4cbb-97f7-0f9c752872c1 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:42.292126 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672a528-2f11-4cbb-97f7-0f9c752872c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:42.308878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-a672a528-2f11-4cbb-97f7-0f9c752872c1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:42.310056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a672a528-2f11-4cbb-97f7-0f9c752872c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:42.373538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 599/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:37:42.399592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b993f-5b2c-489a-bfe8-1cec07d72314 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:42.494279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b993f-5b2c-489a-bfe8-1cec07d72314 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:42.525923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e89472-8085-4077-a261-c35e45b671ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:42.526796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e89472-8085-4077-a261-c35e45b671ac None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:42.527072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e89472-8085-4077-a261-c35e45b671ac None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:42.527342 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e89472-8085-4077-a261-c35e45b671ac None admin] PATH_INFO: `/v3/domains/8ebdb9b068f946029a58a819a463690f` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:42.528497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e89472-8085-4077-a261-c35e45b671ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=8ebdb9b068f946029a58a819a463690f)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:42.529897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e89472-8085-4077-a261-c35e45b671ac None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:42.531498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 577/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Mon Feb 28 21:37:42 2022] GET /identity/v3/domains/8ebdb9b068f946029a58a819a463690f => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:42.537608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672a528-2f11-4cbb-97f7-0f9c752872c1 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:42.629635 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672a528-2f11-4cbb-97f7-0f9c752872c1 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:42.661320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b99ce-98cd-4ac6-8b7f-74c58918683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:42.661967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b99ce-98cd-4ac6-8b7f-74c58918683b None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:42.662276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b99ce-98cd-4ac6-8b7f-74c58918683b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:42.662546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b99ce-98cd-4ac6-8b7f-74c58918683b None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:42.663232 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b99ce-98cd-4ac6-8b7f-74c58918683b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:42.664636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b99ce-98cd-4ac6-8b7f-74c58918683b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:42.785939 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 600/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:37:42 2022] POST /identity/v3/users => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:37:45.098743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786dc8-d4c6-466e-9397-cfeec4033bd1 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:45.099264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786dc8-d4c6-466e-9397-cfeec4033bd1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:45.099264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786dc8-d4c6-466e-9397-cfeec4033bd1 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:45.101076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 578/1178] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:45.106351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af088570-bba7-45bc-9497-fc6a9e40b52c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:45.106737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af088570-bba7-45bc-9497-fc6a9e40b52c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:45.106852 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af088570-bba7-45bc-9497-fc6a9e40b52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:45.124277 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-af088570-bba7-45bc-9497-fc6a9e40b52c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:45.126058 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-af088570-bba7-45bc-9497-fc6a9e40b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:45.187633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 601/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:45.211216 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786dc8-d4c6-466e-9397-cfeec4033bd1 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:45.306333 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786dc8-d4c6-466e-9397-cfeec4033bd1 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:45.337509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79fa97-2f59-4f7e-ad1b-023b37d3c81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:45.338304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79fa97-2f59-4f7e-ad1b-023b37d3c81f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:45.338585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79fa97-2f59-4f7e-ad1b-023b37d3c81f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:45.338856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79fa97-2f59-4f7e-ad1b-023b37d3c81f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:45.348935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79fa97-2f59-4f7e-ad1b-023b37d3c81f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:37:45.355802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-9b79fa97-2f59-4f7e-ad1b-023b37d3c81f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:37:45.356998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 579/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:37:45.363361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af088570-bba7-45bc-9497-fc6a9e40b52c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:45.455288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af088570-bba7-45bc-9497-fc6a9e40b52c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:45.486824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ab92-d271-4068-b469-574dd58eb87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:45.487457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ab92-d271-4068-b469-574dd58eb87b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:45.487733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ab92-d271-4068-b469-574dd58eb87b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:45.488000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ab92-d271-4068-b469-574dd58eb87b None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:45.488727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32ab92-d271-4068-b469-574dd58eb87b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:45.489024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32ab92-d271-4068-b469-574dd58eb87b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:45.490395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32ab92-d271-4068-b469-574dd58eb87b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:45.497963 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 602/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:45.505005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79fa97-2f59-4f7e-ad1b-023b37d3c81f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:45.598408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79fa97-2f59-4f7e-ad1b-023b37d3c81f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:45.631138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a33f5-5018-4ac7-aeaf-15a48063d925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:45.631916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a33f5-5018-4ac7-aeaf-15a48063d925 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:45.632194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a33f5-5018-4ac7-aeaf-15a48063d925 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:45.632465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a33f5-5018-4ac7-aeaf-15a48063d925 None admin] PATH_INFO: `/v3/users/163907473fec4e57918caa1bc3cf5379` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:45.644818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a33f5-5018-4ac7-aeaf-15a48063d925 None admin] RBAC: Authorizing `identity:get_user(user_id=163907473fec4e57918caa1bc3cf5379)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:45.646281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a33f5-5018-4ac7-aeaf-15a48063d925 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:45.647881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 580/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:45 2022] GET /identity/v3/users/163907473fec4e57918caa1bc3cf5379 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:45.653484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ab92-d271-4068-b469-574dd58eb87b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:45.745982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ab92-d271-4068-b469-574dd58eb87b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:45.776666 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917ad20-7031-42f6-8496-6a4d3224da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:45.777289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917ad20-7031-42f6-8496-6a4d3224da25 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:45.777567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917ad20-7031-42f6-8496-6a4d3224da25 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:45.777836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917ad20-7031-42f6-8496-6a4d3224da25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:45.840612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917ad20-7031-42f6-8496-6a4d3224da25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:45.842059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917ad20-7031-42f6-8496-6a4d3224da25 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:45.942702 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 603/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:37:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:37:45.948464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a33f5-5018-4ac7-aeaf-15a48063d925 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:46.041271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a33f5-5018-4ac7-aeaf-15a48063d925 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:46.073543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232df03-46c6-4e8d-afc1-b87e745e9bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:46.074406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232df03-46c6-4e8d-afc1-b87e745e9bb9 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:46.074686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232df03-46c6-4e8d-afc1-b87e745e9bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:46.074959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232df03-46c6-4e8d-afc1-b87e745e9bb9 None admin] PATH_INFO: `/v3/projects/09b0068e00a04a80bb2e1a5aa62a8fa5` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:46.076117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232df03-46c6-4e8d-afc1-b87e745e9bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=09b0068e00a04a80bb2e1a5aa62a8fa5)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:46.077539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232df03-46c6-4e8d-afc1-b87e745e9bb9 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:46.079242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 581/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:37:45 2022] GET /identity/v3/projects/09b0068e00a04a80bb2e1a5aa62a8fa5 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:46.084983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917ad20-7031-42f6-8496-6a4d3224da25 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:46.177683 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917ad20-7031-42f6-8496-6a4d3224da25 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:46.209575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c426fc9-9312-4628-9088-06d56cb9f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:46.210497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c426fc9-9312-4628-9088-06d56cb9f44c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:46.210782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c426fc9-9312-4628-9088-06d56cb9f44c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:46.211057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c426fc9-9312-4628-9088-06d56cb9f44c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:46.211880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c426fc9-9312-4628-9088-06d56cb9f44c None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=09b0068e00a04a80bb2e1a5aa62a8fa5, user.id=163907473fec4e57918caa1bc3cf5379) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:46.212188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c426fc9-9312-4628-9088-06d56cb9f44c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:46.213618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c426fc9-9312-4628-9088-06d56cb9f44c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:46.218801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 604/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:37:46 2022] GET /identity/v3/role_assignments?user.id=163907473fec4e57918caa1bc3cf5379&scope.project.id=09b0068e00a04a80bb2e1a5aa62a8fa5&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:48.467405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51656c9-6bf8-45f0-b3c4-4973fb29a5f5 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:48.468023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51656c9-6bf8-45f0-b3c4-4973fb29a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:48.468023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51656c9-6bf8-45f0-b3c4-4973fb29a5f5 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:48.470365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 582/1186] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:48.475605 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea83fd-41eb-422f-b796-dd46afd8f8f3 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:48.475978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea83fd-41eb-422f-b796-dd46afd8f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:48.476155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea83fd-41eb-422f-b796-dd46afd8f8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:48.492665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e7ea83fd-41eb-422f-b796-dd46afd8f8f3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:48.493853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e7ea83fd-41eb-422f-b796-dd46afd8f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:48.557688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 605/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:48.581422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51656c9-6bf8-45f0-b3c4-4973fb29a5f5 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:48.675412 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51656c9-6bf8-45f0-b3c4-4973fb29a5f5 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:48.707467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adedb29-306d-43fa-b923-28bd8a6d8350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:48.708235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adedb29-306d-43fa-b923-28bd8a6d8350 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:48.708510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adedb29-306d-43fa-b923-28bd8a6d8350 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:48.708778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adedb29-306d-43fa-b923-28bd8a6d8350 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:48.718335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adedb29-306d-43fa-b923-28bd8a6d8350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:37:48.725680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-5adedb29-306d-43fa-b923-28bd8a6d8350 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:37:48.726848 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 583/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:37:48.732766 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea83fd-41eb-422f-b796-dd46afd8f8f3 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:48.829243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea83fd-41eb-422f-b796-dd46afd8f8f3 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:48.863412 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de085a1e-884e-4096-8813-720900f4b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:48.864074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de085a1e-884e-4096-8813-720900f4b5ae None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:48.864356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de085a1e-884e-4096-8813-720900f4b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:48.864630 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de085a1e-884e-4096-8813-720900f4b5ae None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:48.865374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de085a1e-884e-4096-8813-720900f4b5ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:48.865678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de085a1e-884e-4096-8813-720900f4b5ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:48.867071 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de085a1e-884e-4096-8813-720900f4b5ae None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:48.874882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 606/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:48.880876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adedb29-306d-43fa-b923-28bd8a6d8350 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:48.974536 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adedb29-306d-43fa-b923-28bd8a6d8350 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:49.006202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bade6a5-1dca-48f5-9445-81b25ef31fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:49.007056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bade6a5-1dca-48f5-9445-81b25ef31fa0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:49.007338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bade6a5-1dca-48f5-9445-81b25ef31fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:49.007607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bade6a5-1dca-48f5-9445-81b25ef31fa0 None admin] PATH_INFO: `/v3/users/163907473fec4e57918caa1bc3cf5379` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:49.008766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bade6a5-1dca-48f5-9445-81b25ef31fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=163907473fec4e57918caa1bc3cf5379)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:49.010221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bade6a5-1dca-48f5-9445-81b25ef31fa0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:49.011810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 584/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:48 2022] GET /identity/v3/users/163907473fec4e57918caa1bc3cf5379 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:49.018061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de085a1e-884e-4096-8813-720900f4b5ae None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:49.111111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de085a1e-884e-4096-8813-720900f4b5ae None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:49.142407 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff505a-a298-454c-8755-8fed0598c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:49.143239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff505a-a298-454c-8755-8fed0598c03a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:49.143515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff505a-a298-454c-8755-8fed0598c03a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:49.143781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff505a-a298-454c-8755-8fed0598c03a None admin] PATH_INFO: `/v3/projects/09b0068e00a04a80bb2e1a5aa62a8fa5` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:49.144929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff505a-a298-454c-8755-8fed0598c03a None admin] RBAC: Authorizing `identity:get_project(project_id=09b0068e00a04a80bb2e1a5aa62a8fa5)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:49.146366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff505a-a298-454c-8755-8fed0598c03a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:49.147997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 607/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:37:49 2022] GET /identity/v3/projects/09b0068e00a04a80bb2e1a5aa62a8fa5 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:49.153862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bade6a5-1dca-48f5-9445-81b25ef31fa0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:49.246553 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bade6a5-1dca-48f5-9445-81b25ef31fa0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:49.277593 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b7880-9d16-401b-9cd5-7fe87bb62a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:49.278477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b7880-9d16-401b-9cd5-7fe87bb62a0f None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:49.278752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b7880-9d16-401b-9cd5-7fe87bb62a0f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:49.279019 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b7880-9d16-401b-9cd5-7fe87bb62a0f None admin] PATH_INFO: `/v3/projects/09b0068e00a04a80bb2e1a5aa62a8fa5/users/163907473fec4e57918caa1bc3cf5379/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:49.280923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b7880-9d16-401b-9cd5-7fe87bb62a0f None admin] RBAC: Authorizing `identity:create_grant(project_id=09b0068e00a04a80bb2e1a5aa62a8fa5, user_id=163907473fec4e57918caa1bc3cf5379, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:49.282977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b7880-9d16-401b-9cd5-7fe87bb62a0f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:49.356259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 585/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:37:49 2022] PUT /identity/v3/projects/09b0068e00a04a80bb2e1a5aa62a8fa5/users/163907473fec4e57918caa1bc3cf5379/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:37:51.600521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab184-9765-4d78-bfb3-5dc9ab77342c None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:51.601114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab184-9765-4d78-bfb3-5dc9ab77342c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:51.601114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab184-9765-4d78-bfb3-5dc9ab77342c None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:51.602851 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 608/1193] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:37:51.608079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539564-1822-45b2-a756-3f5efb1ca2e3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:51.608517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539564-1822-45b2-a756-3f5efb1ca2e3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:51.608613 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9539564-1822-45b2-a756-3f5efb1ca2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:51.625539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-d9539564-1822-45b2-a756-3f5efb1ca2e3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:37:51.626779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d9539564-1822-45b2-a756-3f5efb1ca2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:37:51.689487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 586/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:37:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:37:51.712088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ab184-9765-4d78-bfb3-5dc9ab77342c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:51.809030 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ab184-9765-4d78-bfb3-5dc9ab77342c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:51.844744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2f0df-76ab-4a3f-a994-a89efc442fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:51.849132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2f0df-76ab-4a3f-a994-a89efc442fd3 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:51.849132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2f0df-76ab-4a3f-a994-a89efc442fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:51.849132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2f0df-76ab-4a3f-a994-a89efc442fd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:51.856547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2f0df-76ab-4a3f-a994-a89efc442fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:37:51.864175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-80b2f0df-76ab-4a3f-a994-a89efc442fd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:37:51.865354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 609/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:37:51.871502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9539564-1822-45b2-a756-3f5efb1ca2e3 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:51.964586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9539564-1822-45b2-a756-3f5efb1ca2e3 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:52.128031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40548e53-c747-4848-ad58-08ab4b93693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:52.128614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40548e53-c747-4848-ad58-08ab4b93693b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:52.128886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40548e53-c747-4848-ad58-08ab4b93693b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:52.129150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40548e53-c747-4848-ad58-08ab4b93693b None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:52.129882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40548e53-c747-4848-ad58-08ab4b93693b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:52.130211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40548e53-c747-4848-ad58-08ab4b93693b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:52.131554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40548e53-c747-4848-ad58-08ab4b93693b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:52.139541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 587/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:37:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:52.145413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2f0df-76ab-4a3f-a994-a89efc442fd3 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:52.240479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2f0df-76ab-4a3f-a994-a89efc442fd3 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:52.273644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0dd2b-6e14-46e6-a40f-226be14dbd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:52.274526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0dd2b-6e14-46e6-a40f-226be14dbd4d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:52.274806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0dd2b-6e14-46e6-a40f-226be14dbd4d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:52.275079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0dd2b-6e14-46e6-a40f-226be14dbd4d None admin] PATH_INFO: `/v3/users/163907473fec4e57918caa1bc3cf5379` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:52.276261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0dd2b-6e14-46e6-a40f-226be14dbd4d None admin] RBAC: Authorizing `identity:get_user(user_id=163907473fec4e57918caa1bc3cf5379)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:52.277680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0dd2b-6e14-46e6-a40f-226be14dbd4d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:52.279332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 610/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Mon Feb 28 21:37:52 2022] GET /identity/v3/users/163907473fec4e57918caa1bc3cf5379 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:52.285461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40548e53-c747-4848-ad58-08ab4b93693b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:52.379591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40548e53-c747-4848-ad58-08ab4b93693b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:52.411300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30324a-f44a-4287-b957-0b71b38768bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:52.411931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30324a-f44a-4287-b957-0b71b38768bf None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:52.412209 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30324a-f44a-4287-b957-0b71b38768bf None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:52.412482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30324a-f44a-4287-b957-0b71b38768bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:52.475212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30324a-f44a-4287-b957-0b71b38768bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:52.476638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30324a-f44a-4287-b957-0b71b38768bf None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:52.570836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 588/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:37:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:37:52.576706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0dd2b-6e14-46e6-a40f-226be14dbd4d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:52.669910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0dd2b-6e14-46e6-a40f-226be14dbd4d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:52.701309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66db48f-79c8-45cd-8898-185f1f59d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:52.702179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66db48f-79c8-45cd-8898-185f1f59d10a None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:52.702462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66db48f-79c8-45cd-8898-185f1f59d10a None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:52.702734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66db48f-79c8-45cd-8898-185f1f59d10a None admin] PATH_INFO: `/v3/projects/09b0068e00a04a80bb2e1a5aa62a8fa5` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:52.704667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66db48f-79c8-45cd-8898-185f1f59d10a None admin] RBAC: Authorizing `identity:get_project(project_id=09b0068e00a04a80bb2e1a5aa62a8fa5)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:52.706120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66db48f-79c8-45cd-8898-185f1f59d10a None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:52.707771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 611/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Mon Feb 28 21:37:52 2022] GET /identity/v3/projects/09b0068e00a04a80bb2e1a5aa62a8fa5 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:37:52.713638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30324a-f44a-4287-b957-0b71b38768bf None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:37:52.805853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30324a-f44a-4287-b957-0b71b38768bf None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:37:52.839050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51f478-9e2a-42b6-b505-aa72f11ccd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:37:52.839697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51f478-9e2a-42b6-b505-aa72f11ccd98 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:37:52.839977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51f478-9e2a-42b6-b505-aa72f11ccd98 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:37:52.840251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51f478-9e2a-42b6-b505-aa72f11ccd98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:37:52.841069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51f478-9e2a-42b6-b505-aa72f11ccd98 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=09b0068e00a04a80bb2e1a5aa62a8fa5, user.id=163907473fec4e57918caa1bc3cf5379) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:37:52.841378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51f478-9e2a-42b6-b505-aa72f11ccd98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:37:52.842824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51f478-9e2a-42b6-b505-aa72f11ccd98 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:37:52.849530 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 589/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:37:52 2022] GET /identity/v3/role_assignments?user.id=163907473fec4e57918caa1bc3cf5379&scope.project.id=09b0068e00a04a80bb2e1a5aa62a8fa5&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:39:15.699739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9233-40c8-4f55-b54a-0f00b43f713b None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:15.700341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9233-40c8-4f55-b54a-0f00b43f713b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:15.700341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9233-40c8-4f55-b54a-0f00b43f713b None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:15.702095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 612/1201] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:39:15.707454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6e901-72e3-4d96-86c1-b0b583c9f9ac None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:15.707878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6e901-72e3-4d96-86c1-b0b583c9f9ac None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:15.707984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6e901-72e3-4d96-86c1-b0b583c9f9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:15.725431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-98f6e901-72e3-4d96-86c1-b0b583c9f9ac None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:15.726634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-98f6e901-72e3-4d96-86c1-b0b583c9f9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:15.790220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 590/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:39:15.814856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9233-40c8-4f55-b54a-0f00b43f713b None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:15.912796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9233-40c8-4f55-b54a-0f00b43f713b None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:16.068506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda593-1ca7-4fcd-b3c0-74da53360597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:16.069276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda593-1ca7-4fcd-b3c0-74da53360597 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:16.069555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda593-1ca7-4fcd-b3c0-74da53360597 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:16.069826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda593-1ca7-4fcd-b3c0-74da53360597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:16.079330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda593-1ca7-4fcd-b3c0-74da53360597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:16.080729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda593-1ca7-4fcd-b3c0-74da53360597 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:16.097319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-4bbda593-1ca7-4fcd-b3c0-74da53360597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:16.098499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 613/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:16.104694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6e901-72e3-4d96-86c1-b0b583c9f9ac None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:16.199509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6e901-72e3-4d96-86c1-b0b583c9f9ac None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:16.231998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065b1c1-e674-462f-8572-af067797e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:16.239694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065b1c1-e674-462f-8572-af067797e256 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:16.239694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065b1c1-e674-462f-8572-af067797e256 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:16.239694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065b1c1-e674-462f-8572-af067797e256 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:16.239694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065b1c1-e674-462f-8572-af067797e256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:16.239694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065b1c1-e674-462f-8572-af067797e256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:16.239694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065b1c1-e674-462f-8572-af067797e256 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:16.247828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 591/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:16.253832 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda593-1ca7-4fcd-b3c0-74da53360597 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:16.351442 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda593-1ca7-4fcd-b3c0-74da53360597 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:16.384001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be329e-9538-4e7c-b386-8d934af10f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:16.384646 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be329e-9538-4e7c-b386-8d934af10f65 None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:16.384923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be329e-9538-4e7c-b386-8d934af10f65 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:16.385193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be329e-9538-4e7c-b386-8d934af10f65 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:16.385881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be329e-9538-4e7c-b386-8d934af10f65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:16.387315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be329e-9538-4e7c-b386-8d934af10f65 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:16.511135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 614/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Mon Feb 28 21:39:16 2022] POST /identity/v3/users => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:39:18.814271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad074b-c8fe-4858-a9ee-7bab4ce97b1c None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:18.814826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad074b-c8fe-4858-a9ee-7bab4ce97b1c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:18.814919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad074b-c8fe-4858-a9ee-7bab4ce97b1c None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:18.816676 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 592/1206] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:39:18.823222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1cac8-479f-4cda-8527-8d4021fe2c3e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:18.823653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1cac8-479f-4cda-8527-8d4021fe2c3e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:18.823770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1cac8-479f-4cda-8527-8d4021fe2c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:18.840443 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-48a1cac8-479f-4cda-8527-8d4021fe2c3e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:18.844284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-48a1cac8-479f-4cda-8527-8d4021fe2c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:18.904945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 615/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:39:18.928861 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad074b-c8fe-4858-a9ee-7bab4ce97b1c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:19.026223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad074b-c8fe-4858-a9ee-7bab4ce97b1c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:19.059162 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378ad33-3b1b-4f03-b41f-e4ba02c72a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:19.059956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378ad33-3b1b-4f03-b41f-e4ba02c72a50 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:19.060217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378ad33-3b1b-4f03-b41f-e4ba02c72a50 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:19.060483 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378ad33-3b1b-4f03-b41f-e4ba02c72a50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:19.071456 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378ad33-3b1b-4f03-b41f-e4ba02c72a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:39:19.078280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-4378ad33-3b1b-4f03-b41f-e4ba02c72a50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:39:19.079459 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 593/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:39:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:19.086409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1cac8-479f-4cda-8527-8d4021fe2c3e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:19.179647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1cac8-479f-4cda-8527-8d4021fe2c3e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:19.211755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dd5a5-265a-442e-8030-764477519bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:19.212444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dd5a5-265a-442e-8030-764477519bb1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:19.212724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dd5a5-265a-442e-8030-764477519bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:19.212997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dd5a5-265a-442e-8030-764477519bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:19.213735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dd5a5-265a-442e-8030-764477519bb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:19.214063 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dd5a5-265a-442e-8030-764477519bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:19.215413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5dd5a5-265a-442e-8030-764477519bb1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:19.223169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 616/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:19.229694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378ad33-3b1b-4f03-b41f-e4ba02c72a50 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:19.326545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378ad33-3b1b-4f03-b41f-e4ba02c72a50 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:19.358344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6892a-07dd-4461-9efd-2a124297b3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:19.367280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6892a-07dd-4461-9efd-2a124297b3e1 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:19.367280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6892a-07dd-4461-9efd-2a124297b3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:19.367280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6892a-07dd-4461-9efd-2a124297b3e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:19.370390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6892a-07dd-4461-9efd-2a124297b3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:19.371816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6892a-07dd-4461-9efd-2a124297b3e1 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:19.388005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-2be6892a-07dd-4461-9efd-2a124297b3e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:19.389159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 594/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:19.395144 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dd5a5-265a-442e-8030-764477519bb1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:19.492181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dd5a5-265a-442e-8030-764477519bb1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:19.524985 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925add-f8fd-4c66-aa5a-1d6cdcd0ed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:19.525637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925add-f8fd-4c66-aa5a-1d6cdcd0ed5f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:19.525918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925add-f8fd-4c66-aa5a-1d6cdcd0ed5f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:19.526217 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925add-f8fd-4c66-aa5a-1d6cdcd0ed5f None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:19.526923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b925add-f8fd-4c66-aa5a-1d6cdcd0ed5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:19.527219 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b925add-f8fd-4c66-aa5a-1d6cdcd0ed5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:19.528555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b925add-f8fd-4c66-aa5a-1d6cdcd0ed5f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:19.540458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 617/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:19.545962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6892a-07dd-4461-9efd-2a124297b3e1 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:19.638755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6892a-07dd-4461-9efd-2a124297b3e1 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:19.670977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf06299-3c59-4d05-a2ea-e4c2c2a7185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:19.671761 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf06299-3c59-4d05-a2ea-e4c2c2a7185a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:19.672038 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf06299-3c59-4d05-a2ea-e4c2c2a7185a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:19.672300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf06299-3c59-4d05-a2ea-e4c2c2a7185a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:19.679517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf06299-3c59-4d05-a2ea-e4c2c2a7185a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:19.687850 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf06299-3c59-4d05-a2ea-e4c2c2a7185a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:19.694378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-cdf06299-3c59-4d05-a2ea-e4c2c2a7185a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 21:39:19.695525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 595/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:19.701569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925add-f8fd-4c66-aa5a-1d6cdcd0ed5f None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:19.799636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925add-f8fd-4c66-aa5a-1d6cdcd0ed5f None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:19.832177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cb9b6-7b38-4260-a1cd-35523098566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:19.832835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cb9b6-7b38-4260-a1cd-35523098566b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:19.833109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cb9b6-7b38-4260-a1cd-35523098566b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:19.833956 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cb9b6-7b38-4260-a1cd-35523098566b None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:19.834806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cb9b6-7b38-4260-a1cd-35523098566b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:19.835103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cb9b6-7b38-4260-a1cd-35523098566b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:19.836506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cb9b6-7b38-4260-a1cd-35523098566b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:19.852711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 618/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Feb 28 21:39:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:19.858579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf06299-3c59-4d05-a2ea-e4c2c2a7185a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:19.954304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf06299-3c59-4d05-a2ea-e4c2c2a7185a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:19.985620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704ada3-718b-4ad5-8b3b-b1f41a4d5aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:19.986318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ada3-718b-4ad5-8b3b-b1f41a4d5aa4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:19.986594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ada3-718b-4ad5-8b3b-b1f41a4d5aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:19.986862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ada3-718b-4ad5-8b3b-b1f41a4d5aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:20.049803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704ada3-718b-4ad5-8b3b-b1f41a4d5aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:20.051250 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704ada3-718b-4ad5-8b3b-b1f41a4d5aa4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:20.142961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 596/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:39:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:39:20.149418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cb9b6-7b38-4260-a1cd-35523098566b None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:20.241394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cb9b6-7b38-4260-a1cd-35523098566b None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:20.272988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056126ea-d266-4204-b126-995d86e56c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:20.273752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056126ea-d266-4204-b126-995d86e56c56 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:20.274048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056126ea-d266-4204-b126-995d86e56c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:20.274320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056126ea-d266-4204-b126-995d86e56c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:20.283662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056126ea-d266-4204-b126-995d86e56c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:20.285093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056126ea-d266-4204-b126-995d86e56c56 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:20.300833 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-056126ea-d266-4204-b126-995d86e56c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:20.302004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 619/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:20.308413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704ada3-718b-4ad5-8b3b-b1f41a4d5aa4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:20.403054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704ada3-718b-4ad5-8b3b-b1f41a4d5aa4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:20.434929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ffaca-abc7-406f-9083-d79ec8513a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:20.435577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ffaca-abc7-406f-9083-d79ec8513a6d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:20.435854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ffaca-abc7-406f-9083-d79ec8513a6d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:20.436127 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ffaca-abc7-406f-9083-d79ec8513a6d None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:20.436835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ffaca-abc7-406f-9083-d79ec8513a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:20.437135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ffaca-abc7-406f-9083-d79ec8513a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:20.438525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ffaca-abc7-406f-9083-d79ec8513a6d None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:20.449228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 597/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:20.455036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056126ea-d266-4204-b126-995d86e56c56 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:20.550600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056126ea-d266-4204-b126-995d86e56c56 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:20.582346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455c070-0c6f-4957-9d27-ff483704f091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:20.583123 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455c070-0c6f-4957-9d27-ff483704f091 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:20.583939 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455c070-0c6f-4957-9d27-ff483704f091 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:20.584212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455c070-0c6f-4957-9d27-ff483704f091 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:20.590698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455c070-0c6f-4957-9d27-ff483704f091 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:20.592124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455c070-0c6f-4957-9d27-ff483704f091 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:20.604957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-5455c070-0c6f-4957-9d27-ff483704f091 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:39:20.606125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 620/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:20.612086 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ffaca-abc7-406f-9083-d79ec8513a6d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:20.706407 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ffaca-abc7-406f-9083-d79ec8513a6d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:20.738261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb65f4-ee54-4a97-9707-e2d2ad8a5894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:20.738908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb65f4-ee54-4a97-9707-e2d2ad8a5894 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:20.739190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb65f4-ee54-4a97-9707-e2d2ad8a5894 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:20.739460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb65f4-ee54-4a97-9707-e2d2ad8a5894 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:20.740393 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb65f4-ee54-4a97-9707-e2d2ad8a5894 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:20.740692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb65f4-ee54-4a97-9707-e2d2ad8a5894 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:20.742133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb65f4-ee54-4a97-9707-e2d2ad8a5894 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:20.753831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 598/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:20.760365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455c070-0c6f-4957-9d27-ff483704f091 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:20.858466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455c070-0c6f-4957-9d27-ff483704f091 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:20.891961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17d99e-2843-4fc8-927a-98d716abd45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:20.892669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17d99e-2843-4fc8-927a-98d716abd45b None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:20.892995 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17d99e-2843-4fc8-927a-98d716abd45b None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:20.893274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17d99e-2843-4fc8-927a-98d716abd45b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:20.894138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17d99e-2843-4fc8-927a-98d716abd45b None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=1875af7b72b247c9a2b5e1f2b2fb1eaa) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:20.894449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17d99e-2843-4fc8-927a-98d716abd45b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:20.897098 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17d99e-2843-4fc8-927a-98d716abd45b None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:20.902417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 621/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:39:20 2022] GET /identity/v3/role_assignments?user.id=1875af7b72b247c9a2b5e1f2b2fb1eaa&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:23.159331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581b52-2466-4fcf-8f24-747ed4a86528 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:23.159878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581b52-2466-4fcf-8f24-747ed4a86528 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:23.159878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581b52-2466-4fcf-8f24-747ed4a86528 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:23.162119 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 599/1220] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:39:23.167317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1f3d-d114-4810-9af9-f21bf3c4e243 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:23.167740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1f3d-d114-4810-9af9-f21bf3c4e243 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:23.167872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a1f3d-d114-4810-9af9-f21bf3c4e243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:23.184808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ec3a1f3d-d114-4810-9af9-f21bf3c4e243 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:23.187720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ec3a1f3d-d114-4810-9af9-f21bf3c4e243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:23.249506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 622/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:39:23.272683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9581b52-2466-4fcf-8f24-747ed4a86528 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:23.373205 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9581b52-2466-4fcf-8f24-747ed4a86528 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:23.406771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364f2f1-daa6-466d-a801-c166dd47613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:23.416921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f2f1-daa6-466d-a801-c166dd47613d None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:23.416921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f2f1-daa6-466d-a801-c166dd47613d None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:23.416921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364f2f1-daa6-466d-a801-c166dd47613d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:23.418298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364f2f1-daa6-466d-a801-c166dd47613d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:39:23.425539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-9364f2f1-daa6-466d-a801-c166dd47613d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:39:23.426742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 600/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:23.433198 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a1f3d-d114-4810-9af9-f21bf3c4e243 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:23.525979 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a1f3d-d114-4810-9af9-f21bf3c4e243 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:23.557563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc4b9-e512-456f-b4ae-7d92110cc7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:23.558231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc4b9-e512-456f-b4ae-7d92110cc7d6 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:23.558509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc4b9-e512-456f-b4ae-7d92110cc7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:23.558778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc4b9-e512-456f-b4ae-7d92110cc7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:23.559508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fc4b9-e512-456f-b4ae-7d92110cc7d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:23.559804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fc4b9-e512-456f-b4ae-7d92110cc7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:23.561193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fc4b9-e512-456f-b4ae-7d92110cc7d6 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:23.569191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 623/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:23.574824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364f2f1-daa6-466d-a801-c166dd47613d None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:23.671663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364f2f1-daa6-466d-a801-c166dd47613d None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:23.703356 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549bf52-a598-40c4-ab90-641d94724c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:23.704621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549bf52-a598-40c4-ab90-641d94724c9a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:23.704621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549bf52-a598-40c4-ab90-641d94724c9a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:23.704825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549bf52-a598-40c4-ab90-641d94724c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:23.715576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549bf52-a598-40c4-ab90-641d94724c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:23.716993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549bf52-a598-40c4-ab90-641d94724c9a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:23.732933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-6549bf52-a598-40c4-ab90-641d94724c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:23.734093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 601/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:39:23.739820 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc4b9-e512-456f-b4ae-7d92110cc7d6 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:23.833224 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc4b9-e512-456f-b4ae-7d92110cc7d6 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:23.865514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a03b1-f1de-4279-adfd-4e456f3e4de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:23.866219 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a03b1-f1de-4279-adfd-4e456f3e4de8 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:23.866501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a03b1-f1de-4279-adfd-4e456f3e4de8 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:23.866768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a03b1-f1de-4279-adfd-4e456f3e4de8 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:23.867498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a03b1-f1de-4279-adfd-4e456f3e4de8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:23.867795 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a03b1-f1de-4279-adfd-4e456f3e4de8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:23.869142 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a03b1-f1de-4279-adfd-4e456f3e4de8 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:23.881107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 624/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:23.886696 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549bf52-a598-40c4-ab90-641d94724c9a None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:23.981642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549bf52-a598-40c4-ab90-641d94724c9a None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:24.015246 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b588d-c8d4-4521-96c0-04375bb8bfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:24.016066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b588d-c8d4-4521-96c0-04375bb8bfca None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:24.016334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b588d-c8d4-4521-96c0-04375bb8bfca None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:24.016601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b588d-c8d4-4521-96c0-04375bb8bfca None admin] PATH_INFO: `/v3/users/placement` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:24.024073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b588d-c8d4-4521-96c0-04375bb8bfca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:24.025488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b588d-c8d4-4521-96c0-04375bb8bfca None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:24.038606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-4e8b588d-c8d4-4521-96c0-04375bb8bfca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 21:39:24.039751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 602/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:24.045443 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a03b1-f1de-4279-adfd-4e456f3e4de8 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:24.141820 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a03b1-f1de-4279-adfd-4e456f3e4de8 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:24.174031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9c7df-f779-4a98-b193-31b289c2d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:24.174984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9c7df-f779-4a98-b193-31b289c2d43d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:24.174984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9c7df-f779-4a98-b193-31b289c2d43d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:24.175221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9c7df-f779-4a98-b193-31b289c2d43d None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:24.176041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9c7df-f779-4a98-b193-31b289c2d43d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:24.176347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9c7df-f779-4a98-b193-31b289c2d43d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:24.178502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9c7df-f779-4a98-b193-31b289c2d43d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:24.196228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 625/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Feb 28 21:39:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:24.201676 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b588d-c8d4-4521-96c0-04375bb8bfca None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:24.299725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b588d-c8d4-4521-96c0-04375bb8bfca None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:24.332865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24414b2e-e303-405d-921a-a7df6eaaecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:24.334184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414b2e-e303-405d-921a-a7df6eaaecba None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:24.334471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414b2e-e303-405d-921a-a7df6eaaecba None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:24.334750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414b2e-e303-405d-921a-a7df6eaaecba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:24.344883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24414b2e-e303-405d-921a-a7df6eaaecba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:24.346418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24414b2e-e303-405d-921a-a7df6eaaecba None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:24.363293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-24414b2e-e303-405d-921a-a7df6eaaecba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:24.364473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 603/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:39:24.371313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9c7df-f779-4a98-b193-31b289c2d43d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:24.468305 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9c7df-f779-4a98-b193-31b289c2d43d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:24.502735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7c374-8a4a-4684-b040-22c7dd9493d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:24.503391 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7c374-8a4a-4684-b040-22c7dd9493d4 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:24.503709 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7c374-8a4a-4684-b040-22c7dd9493d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:24.503980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7c374-8a4a-4684-b040-22c7dd9493d4 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:24.504684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7c374-8a4a-4684-b040-22c7dd9493d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:24.504990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7c374-8a4a-4684-b040-22c7dd9493d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:24.506485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7c374-8a4a-4684-b040-22c7dd9493d4 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:24.517316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 626/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:24.522968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24414b2e-e303-405d-921a-a7df6eaaecba None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:24.618044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24414b2e-e303-405d-921a-a7df6eaaecba None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:24.649809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d55f0-1648-430b-b1df-2f5d68c6cb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:24.652007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d55f0-1648-430b-b1df-2f5d68c6cb14 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:24.652007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d55f0-1648-430b-b1df-2f5d68c6cb14 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:24.652007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d55f0-1648-430b-b1df-2f5d68c6cb14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:24.657501 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d55f0-1648-430b-b1df-2f5d68c6cb14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:24.658975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d55f0-1648-430b-b1df-2f5d68c6cb14 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:24.672984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-8d1d55f0-1648-430b-b1df-2f5d68c6cb14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:39:24.680863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 604/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:24.680989 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7c374-8a4a-4684-b040-22c7dd9493d4 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:24.776548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7c374-8a4a-4684-b040-22c7dd9493d4 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:24.808242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38422a-8536-445c-9f8b-61f4210ec406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:24.808893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38422a-8536-445c-9f8b-61f4210ec406 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:24.809171 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38422a-8536-445c-9f8b-61f4210ec406 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:24.809443 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38422a-8536-445c-9f8b-61f4210ec406 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:24.810249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38422a-8536-445c-9f8b-61f4210ec406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:24.815733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38422a-8536-445c-9f8b-61f4210ec406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:24.815733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38422a-8536-445c-9f8b-61f4210ec406 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:24.824526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 627/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:24.830486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d55f0-1648-430b-b1df-2f5d68c6cb14 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:24.925039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d55f0-1648-430b-b1df-2f5d68c6cb14 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:24.957209 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc668e-f8a4-4389-9926-6d82f4fdac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:24.958102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc668e-f8a4-4389-9926-6d82f4fdac95 None admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:24.958894 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc668e-f8a4-4389-9926-6d82f4fdac95 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:24.959323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc668e-f8a4-4389-9926-6d82f4fdac95 None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/1875af7b72b247c9a2b5e1f2b2fb1eaa/roles/513cc23fb1004763b19adb0e0ce40802` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:24.973195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc668e-f8a4-4389-9926-6d82f4fdac95 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=1875af7b72b247c9a2b5e1f2b2fb1eaa, role_id=513cc23fb1004763b19adb0e0ce40802)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:24.975355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc668e-f8a4-4389-9926-6d82f4fdac95 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:25.078765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 605/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:39:24 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/1875af7b72b247c9a2b5e1f2b2fb1eaa/roles/513cc23fb1004763b19adb0e0ce40802 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:39:27.397707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfddc2-1726-4f71-adb0-8bd8178b4ee5 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:27.398317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfddc2-1726-4f71-adb0-8bd8178b4ee5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:27.398317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfddc2-1726-4f71-adb0-8bd8178b4ee5 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:27.400001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 628/1233] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:39:27.405191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef17ad-15b8-491b-8059-459a90af7198 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:27.405572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef17ad-15b8-491b-8059-459a90af7198 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:27.405732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef17ad-15b8-491b-8059-459a90af7198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:27.422579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-29ef17ad-15b8-491b-8059-459a90af7198 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:27.423799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-29ef17ad-15b8-491b-8059-459a90af7198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:27.487293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 606/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:39:27.511740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfddc2-1726-4f71-adb0-8bd8178b4ee5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:27.607169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfddc2-1726-4f71-adb0-8bd8178b4ee5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:27.640028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560442-5a44-497c-a362-8d768bceda58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:27.640853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560442-5a44-497c-a362-8d768bceda58 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:27.641132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560442-5a44-497c-a362-8d768bceda58 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:27.641402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09560442-5a44-497c-a362-8d768bceda58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:27.652454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09560442-5a44-497c-a362-8d768bceda58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:39:27.659513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-09560442-5a44-497c-a362-8d768bceda58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 28 21:39:27.660676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 629/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Mon Feb 28 21:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:27.667362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef17ad-15b8-491b-8059-459a90af7198 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:27.761538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef17ad-15b8-491b-8059-459a90af7198 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:27.793122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f776f9-d34c-4a15-af68-53c428f1ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:27.793769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f776f9-d34c-4a15-af68-53c428f1ee8e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:27.794071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f776f9-d34c-4a15-af68-53c428f1ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:27.794338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f776f9-d34c-4a15-af68-53c428f1ee8e None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:27.795073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f776f9-d34c-4a15-af68-53c428f1ee8e None admin] RBAC: Adding query filter params (name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:27.795371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f776f9-d34c-4a15-af68-53c428f1ee8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:27.796811 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f776f9-d34c-4a15-af68-53c428f1ee8e None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:27.805209 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 607/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Mon Feb 28 21:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:27.810875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560442-5a44-497c-a362-8d768bceda58 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:27.912076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09560442-5a44-497c-a362-8d768bceda58 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:27.943446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4345df0-df4b-444e-becf-0c27071aa8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:27.944215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4345df0-df4b-444e-becf-0c27071aa8ad None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:27.944551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4345df0-df4b-444e-becf-0c27071aa8ad None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:27.944805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4345df0-df4b-444e-becf-0c27071aa8ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:27.954906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4345df0-df4b-444e-becf-0c27071aa8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:27.956347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4345df0-df4b-444e-becf-0c27071aa8ad None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:27.972167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-b4345df0-df4b-444e-becf-0c27071aa8ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:27.973341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 630/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:27.979191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f776f9-d34c-4a15-af68-53c428f1ee8e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:28.073452 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f776f9-d34c-4a15-af68-53c428f1ee8e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:28.105432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6242a-6a73-450b-a7b1-7ffbff590335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:28.106221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6242a-6a73-450b-a7b1-7ffbff590335 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:28.106507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6242a-6a73-450b-a7b1-7ffbff590335 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:28.106779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6242a-6a73-450b-a7b1-7ffbff590335 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:28.107482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6242a-6a73-450b-a7b1-7ffbff590335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:28.107785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6242a-6a73-450b-a7b1-7ffbff590335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:28.109129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6242a-6a73-450b-a7b1-7ffbff590335 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:28.120266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 608/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:28.125799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4345df0-df4b-444e-becf-0c27071aa8ad None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:28.221859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4345df0-df4b-444e-becf-0c27071aa8ad None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:28.253207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bb6af-c9de-4433-a982-e57805838505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:28.256155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bb6af-c9de-4433-a982-e57805838505 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:28.256155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bb6af-c9de-4433-a982-e57805838505 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:28.256155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bb6af-c9de-4433-a982-e57805838505 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:28.262464 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bb6af-c9de-4433-a982-e57805838505 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:28.263879 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bb6af-c9de-4433-a982-e57805838505 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:28.278061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-aa7bb6af-c9de-4433-a982-e57805838505 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 21:39:28.279360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 631/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:28.285104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6242a-6a73-450b-a7b1-7ffbff590335 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:28.380549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6242a-6a73-450b-a7b1-7ffbff590335 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:28.412552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4052f-5ee0-4f6c-9504-ea4064995df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:28.413202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4052f-5ee0-4f6c-9504-ea4064995df0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:28.413482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4052f-5ee0-4f6c-9504-ea4064995df0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:28.413752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4052f-5ee0-4f6c-9504-ea4064995df0 None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:28.414604 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4052f-5ee0-4f6c-9504-ea4064995df0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:28.415031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4052f-5ee0-4f6c-9504-ea4064995df0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:28.422616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4052f-5ee0-4f6c-9504-ea4064995df0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:28.433365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 609/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Feb 28 21:39:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:28.439046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bb6af-c9de-4433-a982-e57805838505 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:28.532714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bb6af-c9de-4433-a982-e57805838505 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:28.563452 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89685ff7-03a9-4960-93df-c26c6384d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:28.564075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89685ff7-03a9-4960-93df-c26c6384d842 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:28.564351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89685ff7-03a9-4960-93df-c26c6384d842 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:28.564619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89685ff7-03a9-4960-93df-c26c6384d842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:28.628172 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89685ff7-03a9-4960-93df-c26c6384d842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:28.629592 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89685ff7-03a9-4960-93df-c26c6384d842 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:28.722233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 632/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:39:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:39:28.728878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4052f-5ee0-4f6c-9504-ea4064995df0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:28.823431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4052f-5ee0-4f6c-9504-ea4064995df0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:28.856923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c95974-0e7c-4038-989e-82ce25442f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:28.857713 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c95974-0e7c-4038-989e-82ce25442f8c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:28.858006 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c95974-0e7c-4038-989e-82ce25442f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:28.858278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c95974-0e7c-4038-989e-82ce25442f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:28.868787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c95974-0e7c-4038-989e-82ce25442f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:28.870241 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c95974-0e7c-4038-989e-82ce25442f8c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:28.888275 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-36c95974-0e7c-4038-989e-82ce25442f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:28.889489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 610/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:39:28.895360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89685ff7-03a9-4960-93df-c26c6384d842 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:28.992024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89685ff7-03a9-4960-93df-c26c6384d842 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:29.025558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db24c8-5a67-43a0-99af-d61095157fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:29.026238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db24c8-5a67-43a0-99af-d61095157fff None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:29.026520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db24c8-5a67-43a0-99af-d61095157fff None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:29.026798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db24c8-5a67-43a0-99af-d61095157fff None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:29.027503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db24c8-5a67-43a0-99af-d61095157fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:29.027836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db24c8-5a67-43a0-99af-d61095157fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:29.029184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db24c8-5a67-43a0-99af-d61095157fff None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:29.040457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 633/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:29.046188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c95974-0e7c-4038-989e-82ce25442f8c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:29.140981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c95974-0e7c-4038-989e-82ce25442f8c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:29.173157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8d89-e73f-4ca9-8e18-466632aeac73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:29.173933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8d89-e73f-4ca9-8e18-466632aeac73 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:29.174235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8d89-e73f-4ca9-8e18-466632aeac73 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:29.174511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a8d89-e73f-4ca9-8e18-466632aeac73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:29.181465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a8d89-e73f-4ca9-8e18-466632aeac73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:29.182911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a8d89-e73f-4ca9-8e18-466632aeac73 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:29.196269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-740a8d89-e73f-4ca9-8e18-466632aeac73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:39:29.197456 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 611/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:29.203396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db24c8-5a67-43a0-99af-d61095157fff None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:29.299685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db24c8-5a67-43a0-99af-d61095157fff None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:29.332249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bc9b6-5f3e-44ee-a7d2-dd50e52cb66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:29.332922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bc9b6-5f3e-44ee-a7d2-dd50e52cb66f None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:29.333716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bc9b6-5f3e-44ee-a7d2-dd50e52cb66f None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:29.334459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bc9b6-5f3e-44ee-a7d2-dd50e52cb66f None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:29.335246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bc9b6-5f3e-44ee-a7d2-dd50e52cb66f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:29.337759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bc9b6-5f3e-44ee-a7d2-dd50e52cb66f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:29.337759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bc9b6-5f3e-44ee-a7d2-dd50e52cb66f None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:29.348495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 634/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:39:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:29.355091 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8d89-e73f-4ca9-8e18-466632aeac73 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:29.453373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a8d89-e73f-4ca9-8e18-466632aeac73 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:29.485460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6e39a-4436-4c0b-9e49-22317f44999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:29.486129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6e39a-4436-4c0b-9e49-22317f44999a None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:29.486407 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6e39a-4436-4c0b-9e49-22317f44999a None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:29.486677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6e39a-4436-4c0b-9e49-22317f44999a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:29.487486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6e39a-4436-4c0b-9e49-22317f44999a None admin] RBAC: Adding query filter params (role.id=513cc23fb1004763b19adb0e0ce40802, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=1875af7b72b247c9a2b5e1f2b2fb1eaa) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:29.487791 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6e39a-4436-4c0b-9e49-22317f44999a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:29.489205 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6e39a-4436-4c0b-9e49-22317f44999a None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:29.495299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 612/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:39:29 2022] GET /identity/v3/role_assignments?user.id=1875af7b72b247c9a2b5e1f2b2fb1eaa&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=513cc23fb1004763b19adb0e0ce40802 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:39:31.839211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba35d42-54b0-4c8d-81e8-4f8808633032 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:31.839754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba35d42-54b0-4c8d-81e8-4f8808633032 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:31.839754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba35d42-54b0-4c8d-81e8-4f8808633032 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:31.841472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 635/1247] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:39:31.846568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd9ca-95ac-4202-a41b-be6144e73f32 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:31.846963 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd9ca-95ac-4202-a41b-be6144e73f32 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:31.847106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd9ca-95ac-4202-a41b-be6144e73f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:31.864086 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-df1fd9ca-95ac-4202-a41b-be6144e73f32 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:31.865322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-df1fd9ca-95ac-4202-a41b-be6144e73f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:31.930007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 613/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:39:31.953346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba35d42-54b0-4c8d-81e8-4f8808633032 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:32.048866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba35d42-54b0-4c8d-81e8-4f8808633032 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:32.080424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384dfd1-b17e-472e-a344-12eafee33753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:32.081204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384dfd1-b17e-472e-a344-12eafee33753 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:32.081480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384dfd1-b17e-472e-a344-12eafee33753 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:32.081750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384dfd1-b17e-472e-a344-12eafee33753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:32.092317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384dfd1-b17e-472e-a344-12eafee33753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:39:32.099249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-6384dfd1-b17e-472e-a344-12eafee33753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:39:32.100430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 636/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:39:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:32.106610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd9ca-95ac-4202-a41b-be6144e73f32 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:32.215275 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd9ca-95ac-4202-a41b-be6144e73f32 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:32.247810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d513b3-8d49-442d-8d37-673a6aba0ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:32.248462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d513b3-8d49-442d-8d37-673a6aba0ca0 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:32.248738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d513b3-8d49-442d-8d37-673a6aba0ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:32.249008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d513b3-8d49-442d-8d37-673a6aba0ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:32.249779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d513b3-8d49-442d-8d37-673a6aba0ca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:32.250359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d513b3-8d49-442d-8d37-673a6aba0ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:32.251706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d513b3-8d49-442d-8d37-673a6aba0ca0 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:32.259925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 614/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:39:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:32.265702 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384dfd1-b17e-472e-a344-12eafee33753 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:32.361232 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384dfd1-b17e-472e-a344-12eafee33753 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:32.394006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9110f-57e7-4c14-8c4e-658592e52708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:32.394790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9110f-57e7-4c14-8c4e-658592e52708 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:32.395072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9110f-57e7-4c14-8c4e-658592e52708 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:32.395347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9110f-57e7-4c14-8c4e-658592e52708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:32.405643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9110f-57e7-4c14-8c4e-658592e52708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:32.407103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9110f-57e7-4c14-8c4e-658592e52708 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:32.423125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-7ff9110f-57e7-4c14-8c4e-658592e52708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:32.424268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 637/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:32.431068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d513b3-8d49-442d-8d37-673a6aba0ca0 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:32.527230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d513b3-8d49-442d-8d37-673a6aba0ca0 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:32.559625 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ce6c6-b546-46c1-a007-d99de744bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:32.560279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ce6c6-b546-46c1-a007-d99de744bfab None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:32.560561 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ce6c6-b546-46c1-a007-d99de744bfab None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:32.560835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ce6c6-b546-46c1-a007-d99de744bfab None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:32.561552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ce6c6-b546-46c1-a007-d99de744bfab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:32.561856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ce6c6-b546-46c1-a007-d99de744bfab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:32.563242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ce6c6-b546-46c1-a007-d99de744bfab None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:32.575239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 615/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:39:32.580974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9110f-57e7-4c14-8c4e-658592e52708 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:32.674955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9110f-57e7-4c14-8c4e-658592e52708 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:32.707475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1c2a2-ae87-437c-a395-2cc41d0cbeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:32.708351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c2a2-ae87-437c-a395-2cc41d0cbeb6 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:32.708700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c2a2-ae87-437c-a395-2cc41d0cbeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:32.708985 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c2a2-ae87-437c-a395-2cc41d0cbeb6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:32.716033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1c2a2-ae87-437c-a395-2cc41d0cbeb6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:32.717441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1c2a2-ae87-437c-a395-2cc41d0cbeb6 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:32.731081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-6eb1c2a2-ae87-437c-a395-2cc41d0cbeb6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 21:39:32.732277 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 638/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:32.737917 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ce6c6-b546-46c1-a007-d99de744bfab None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:32.831494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ce6c6-b546-46c1-a007-d99de744bfab None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:32.863618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d2575-0bc4-461c-9770-895d0d2a3a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:32.864279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d2575-0bc4-461c-9770-895d0d2a3a5b None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:32.865189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d2575-0bc4-461c-9770-895d0d2a3a5b None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:32.865420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d2575-0bc4-461c-9770-895d0d2a3a5b None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:32.866270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d2575-0bc4-461c-9770-895d0d2a3a5b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:32.866571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d2575-0bc4-461c-9770-895d0d2a3a5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:32.867978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d2575-0bc4-461c-9770-895d0d2a3a5b None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:32.885096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 616/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Feb 28 21:39:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:32.890665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1c2a2-ae87-437c-a395-2cc41d0cbeb6 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:32.985088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1c2a2-ae87-437c-a395-2cc41d0cbeb6 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:33.016204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee001-63ef-41d9-83e2-83f6628541af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:33.032168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee001-63ef-41d9-83e2-83f6628541af None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:33.032168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee001-63ef-41d9-83e2-83f6628541af None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:33.032168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eee001-63ef-41d9-83e2-83f6628541af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:33.081261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eee001-63ef-41d9-83e2-83f6628541af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:33.082721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eee001-63ef-41d9-83e2-83f6628541af None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:33.175813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 639/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:39:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:39:33.181938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d2575-0bc4-461c-9770-895d0d2a3a5b None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:33.276734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d2575-0bc4-461c-9770-895d0d2a3a5b None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:33.308459 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf5e74-82b9-4fa4-9c47-a39eb27428f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:33.309250 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf5e74-82b9-4fa4-9c47-a39eb27428f4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:33.309530 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf5e74-82b9-4fa4-9c47-a39eb27428f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:33.309802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf5e74-82b9-4fa4-9c47-a39eb27428f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:33.320091 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf5e74-82b9-4fa4-9c47-a39eb27428f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:33.321533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf5e74-82b9-4fa4-9c47-a39eb27428f4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:33.338332 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-71bf5e74-82b9-4fa4-9c47-a39eb27428f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:33.339480 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 617/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:33.345235 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee001-63ef-41d9-83e2-83f6628541af None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:33.439659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eee001-63ef-41d9-83e2-83f6628541af None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:33.471484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269baed5-86a1-4a9e-9bc7-fa859b542eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:33.472254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269baed5-86a1-4a9e-9bc7-fa859b542eda None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:33.472462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269baed5-86a1-4a9e-9bc7-fa859b542eda None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:33.472733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269baed5-86a1-4a9e-9bc7-fa859b542eda None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:33.473439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269baed5-86a1-4a9e-9bc7-fa859b542eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:33.474291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269baed5-86a1-4a9e-9bc7-fa859b542eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:33.475639 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269baed5-86a1-4a9e-9bc7-fa859b542eda None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:33.486304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 640/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:33.492488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf5e74-82b9-4fa4-9c47-a39eb27428f4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:33.587311 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf5e74-82b9-4fa4-9c47-a39eb27428f4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:33.620073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef2e0-c6e8-4d4d-8ec5-e419ffb84941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:33.620848 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef2e0-c6e8-4d4d-8ec5-e419ffb84941 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:33.621126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef2e0-c6e8-4d4d-8ec5-e419ffb84941 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:33.621398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef2e0-c6e8-4d4d-8ec5-e419ffb84941 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:33.628122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef2e0-c6e8-4d4d-8ec5-e419ffb84941 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:33.629550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef2e0-c6e8-4d4d-8ec5-e419ffb84941 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:33.642373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-948ef2e0-c6e8-4d4d-8ec5-e419ffb84941 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:39:33.643580 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 618/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:33.650286 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269baed5-86a1-4a9e-9bc7-fa859b542eda None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:33.744131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269baed5-86a1-4a9e-9bc7-fa859b542eda None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:33.775911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731c22d-3b93-4a9a-98f1-e8079b0a2292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:33.776556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731c22d-3b93-4a9a-98f1-e8079b0a2292 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:33.776832 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731c22d-3b93-4a9a-98f1-e8079b0a2292 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:33.777102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731c22d-3b93-4a9a-98f1-e8079b0a2292 None admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:33.777862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731c22d-3b93-4a9a-98f1-e8079b0a2292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:33.778194 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731c22d-3b93-4a9a-98f1-e8079b0a2292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:33.779608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731c22d-3b93-4a9a-98f1-e8079b0a2292 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:33.792473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 641/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:33.798516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef2e0-c6e8-4d4d-8ec5-e419ffb84941 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:33.893189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef2e0-c6e8-4d4d-8ec5-e419ffb84941 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:33.925249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f7d20-a568-4a6d-8efd-6be3dbabf545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:33.925896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f7d20-a568-4a6d-8efd-6be3dbabf545 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:33.926207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f7d20-a568-4a6d-8efd-6be3dbabf545 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:33.926479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f7d20-a568-4a6d-8efd-6be3dbabf545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:33.927345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f7d20-a568-4a6d-8efd-6be3dbabf545 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=1875af7b72b247c9a2b5e1f2b2fb1eaa) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:33.927650 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f7d20-a568-4a6d-8efd-6be3dbabf545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:33.929066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f7d20-a568-4a6d-8efd-6be3dbabf545 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:33.934449 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 619/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:39:33 2022] GET /identity/v3/role_assignments?user.id=1875af7b72b247c9a2b5e1f2b2fb1eaa&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:36.189310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94dec-e20f-44de-b942-77f377a058eb None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:36.189882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94dec-e20f-44de-b942-77f377a058eb None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:36.189882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94dec-e20f-44de-b942-77f377a058eb None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:36.191518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 642/1261] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:39:36.197163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb03e6-7544-40ab-99b4-7896c67f0134 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:36.197638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb03e6-7544-40ab-99b4-7896c67f0134 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:36.197746 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb03e6-7544-40ab-99b4-7896c67f0134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:36.214761 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-0cfb03e6-7544-40ab-99b4-7896c67f0134 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:36.215923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0cfb03e6-7544-40ab-99b4-7896c67f0134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:36.280199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 620/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:39:36.303155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94dec-e20f-44de-b942-77f377a058eb None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:36.402458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94dec-e20f-44de-b942-77f377a058eb None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:36.434794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d908-a5bb-4230-b96a-c492d3e23948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:36.435571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d908-a5bb-4230-b96a-c492d3e23948 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:36.435854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d908-a5bb-4230-b96a-c492d3e23948 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:36.436130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d908-a5bb-4230-b96a-c492d3e23948 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:36.446879 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4d908-a5bb-4230-b96a-c492d3e23948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:39:36.453745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-91d4d908-a5bb-4230-b96a-c492d3e23948 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:39:36.455006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 643/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:36.462085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb03e6-7544-40ab-99b4-7896c67f0134 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:36.554306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb03e6-7544-40ab-99b4-7896c67f0134 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:36.587491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c238f-5ef0-437d-bb9d-a465c0077ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:36.588170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c238f-5ef0-437d-bb9d-a465c0077ab6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:36.588449 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c238f-5ef0-437d-bb9d-a465c0077ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:36.588719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c238f-5ef0-437d-bb9d-a465c0077ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:36.589452 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c238f-5ef0-437d-bb9d-a465c0077ab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:36.589753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c238f-5ef0-437d-bb9d-a465c0077ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:36.591147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c238f-5ef0-437d-bb9d-a465c0077ab6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:36.598799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 621/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:36.604612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d908-a5bb-4230-b96a-c492d3e23948 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:36.698285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d908-a5bb-4230-b96a-c492d3e23948 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:36.729324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198a29c-14dc-4cd0-a2f1-4175673cbfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:36.730170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a29c-14dc-4cd0-a2f1-4175673cbfa1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:36.730447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a29c-14dc-4cd0-a2f1-4175673cbfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:36.741244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a29c-14dc-4cd0-a2f1-4175673cbfa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:36.741244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198a29c-14dc-4cd0-a2f1-4175673cbfa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:36.742677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198a29c-14dc-4cd0-a2f1-4175673cbfa1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:36.759162 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-a198a29c-14dc-4cd0-a2f1-4175673cbfa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:36.760279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 644/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:36.765943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c238f-5ef0-437d-bb9d-a465c0077ab6 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:36.860624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c238f-5ef0-437d-bb9d-a465c0077ab6 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:36.894498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346db70-9b5a-4d16-bb54-599e284f2444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:36.895162 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346db70-9b5a-4d16-bb54-599e284f2444 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:36.896267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346db70-9b5a-4d16-bb54-599e284f2444 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:36.896267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346db70-9b5a-4d16-bb54-599e284f2444 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:36.896473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346db70-9b5a-4d16-bb54-599e284f2444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:36.896779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346db70-9b5a-4d16-bb54-599e284f2444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:36.898178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346db70-9b5a-4d16-bb54-599e284f2444 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:36.909485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 622/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:36.915544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198a29c-14dc-4cd0-a2f1-4175673cbfa1 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:37.011509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198a29c-14dc-4cd0-a2f1-4175673cbfa1 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:37.043103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19677-50ec-4dff-b91e-62e0c6c6adfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:37.043930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19677-50ec-4dff-b91e-62e0c6c6adfc None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:37.044211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19677-50ec-4dff-b91e-62e0c6c6adfc None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:37.044481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec19677-50ec-4dff-b91e-62e0c6c6adfc None admin] PATH_INFO: `/v3/users/placement` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:37.051589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec19677-50ec-4dff-b91e-62e0c6c6adfc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:37.053608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec19677-50ec-4dff-b91e-62e0c6c6adfc None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:37.066945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-7ec19677-50ec-4dff-b91e-62e0c6c6adfc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 21:39:37.068139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 645/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:37.073913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346db70-9b5a-4d16-bb54-599e284f2444 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:37.168554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346db70-9b5a-4d16-bb54-599e284f2444 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:37.200949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e127c0-9c14-4bd5-a80f-e73dff072cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:37.201610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e127c0-9c14-4bd5-a80f-e73dff072cea None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:37.201889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e127c0-9c14-4bd5-a80f-e73dff072cea None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:37.202202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e127c0-9c14-4bd5-a80f-e73dff072cea None admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:37.203032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e127c0-9c14-4bd5-a80f-e73dff072cea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:37.203444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e127c0-9c14-4bd5-a80f-e73dff072cea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:37.204875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e127c0-9c14-4bd5-a80f-e73dff072cea None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:37.222688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 623/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Feb 28 21:39:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:37.229072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19677-50ec-4dff-b91e-62e0c6c6adfc None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:37.323532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec19677-50ec-4dff-b91e-62e0c6c6adfc None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:37.356210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4575f-b418-4494-a6bb-0501849f74b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:37.356984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4575f-b418-4494-a6bb-0501849f74b5 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:37.357258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4575f-b418-4494-a6bb-0501849f74b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:37.357520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4575f-b418-4494-a6bb-0501849f74b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:37.368285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4575f-b418-4494-a6bb-0501849f74b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:37.369688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4575f-b418-4494-a6bb-0501849f74b5 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:37.385737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-16f4575f-b418-4494-a6bb-0501849f74b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:37.386979 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 646/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:37.392745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e127c0-9c14-4bd5-a80f-e73dff072cea None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:37.488850 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e127c0-9c14-4bd5-a80f-e73dff072cea None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:37.521955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c94d9-ed07-49e5-9c0a-13d61dd4aa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:37.522679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c94d9-ed07-49e5-9c0a-13d61dd4aa99 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:37.523107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c94d9-ed07-49e5-9c0a-13d61dd4aa99 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:37.523382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c94d9-ed07-49e5-9c0a-13d61dd4aa99 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:37.524108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c94d9-ed07-49e5-9c0a-13d61dd4aa99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:37.524405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c94d9-ed07-49e5-9c0a-13d61dd4aa99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:37.525776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c94d9-ed07-49e5-9c0a-13d61dd4aa99 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:37.538656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 624/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:37.544284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4575f-b418-4494-a6bb-0501849f74b5 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:37.640450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4575f-b418-4494-a6bb-0501849f74b5 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:37.673135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61400ee4-47b5-493f-9b6b-e0ebe144fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:37.673907 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400ee4-47b5-493f-9b6b-e0ebe144fb41 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:37.674214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400ee4-47b5-493f-9b6b-e0ebe144fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:37.674483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400ee4-47b5-493f-9b6b-e0ebe144fb41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:37.680985 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61400ee4-47b5-493f-9b6b-e0ebe144fb41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:37.682457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61400ee4-47b5-493f-9b6b-e0ebe144fb41 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:37.695968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-61400ee4-47b5-493f-9b6b-e0ebe144fb41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:39:37.697103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 647/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:37.703009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c94d9-ed07-49e5-9c0a-13d61dd4aa99 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:37.798955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c94d9-ed07-49e5-9c0a-13d61dd4aa99 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:37.835064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4f893-8dc2-4b5e-acf6-af8a311f9888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:37.835726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f893-8dc2-4b5e-acf6-af8a311f9888 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:37.836005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f893-8dc2-4b5e-acf6-af8a311f9888 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:37.836274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f893-8dc2-4b5e-acf6-af8a311f9888 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:37.837047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4f893-8dc2-4b5e-acf6-af8a311f9888 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:37.837349 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4f893-8dc2-4b5e-acf6-af8a311f9888 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:37.838798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4f893-8dc2-4b5e-acf6-af8a311f9888 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:37.850501 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 625/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:39:37.859201 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61400ee4-47b5-493f-9b6b-e0ebe144fb41 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:37.949373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61400ee4-47b5-493f-9b6b-e0ebe144fb41 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:37.981413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a358326-c85d-49b2-a66f-d97726fd0373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:37.982314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a358326-c85d-49b2-a66f-d97726fd0373 None admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:37.982595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a358326-c85d-49b2-a66f-d97726fd0373 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:37.987538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a358326-c85d-49b2-a66f-d97726fd0373 None admin] PATH_INFO: `/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/1875af7b72b247c9a2b5e1f2b2fb1eaa/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:37.987538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a358326-c85d-49b2-a66f-d97726fd0373 None admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5f76f1ecc444e90b82818ac55901b, user_id=1875af7b72b247c9a2b5e1f2b2fb1eaa, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:37.987538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a358326-c85d-49b2-a66f-d97726fd0373 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:38.085425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 648/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Mon Feb 28 21:39:37 2022] PUT /identity/v3/projects/c6d5f76f1ecc444e90b82818ac55901b/users/1875af7b72b247c9a2b5e1f2b2fb1eaa/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:39:40.351865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa79b77-4169-47be-8069-83a0c17b862c None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:40.352395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa79b77-4169-47be-8069-83a0c17b862c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:40.352395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa79b77-4169-47be-8069-83a0c17b862c None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:40.354207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 626/1274] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:39:40.359493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362c74-9063-4091-b1ec-8e8d3809c2e4 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:40.359883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362c74-9063-4091-b1ec-8e8d3809c2e4 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:40.360044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362c74-9063-4091-b1ec-8e8d3809c2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:40.377368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e5362c74-9063-4091-b1ec-8e8d3809c2e4 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:40.378577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e5362c74-9063-4091-b1ec-8e8d3809c2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:40.444609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 649/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:39:40.467404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa79b77-4169-47be-8069-83a0c17b862c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:40.563512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa79b77-4169-47be-8069-83a0c17b862c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:40.595357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8b43-6b56-445d-bfa0-1131c3e3de2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:40.596133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8b43-6b56-445d-bfa0-1131c3e3de2e None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:40.596411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8b43-6b56-445d-bfa0-1131c3e3de2e None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:40.596683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc8b43-6b56-445d-bfa0-1131c3e3de2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:40.607067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc8b43-6b56-445d-bfa0-1131c3e3de2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 28 21:39:40.614013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-fdbc8b43-6b56-445d-bfa0-1131c3e3de2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 28 21:39:40.615267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 627/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Mon Feb 28 21:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 28 21:39:40.622093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362c74-9063-4091-b1ec-8e8d3809c2e4 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:40.715734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362c74-9063-4091-b1ec-8e8d3809c2e4 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:40.747857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e69b-e2f7-46cf-8a05-ceb60a555e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:40.748506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e69b-e2f7-46cf-8a05-ceb60a555e0d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:40.748783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e69b-e2f7-46cf-8a05-ceb60a555e0d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:40.749054 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075e69b-e2f7-46cf-8a05-ceb60a555e0d None admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:40.750048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075e69b-e2f7-46cf-8a05-ceb60a555e0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:40.750359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075e69b-e2f7-46cf-8a05-ceb60a555e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:40.751696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075e69b-e2f7-46cf-8a05-ceb60a555e0d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:40.759546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 650/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Mon Feb 28 21:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:40.765243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8b43-6b56-445d-bfa0-1131c3e3de2e None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:40.860861 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc8b43-6b56-445d-bfa0-1131c3e3de2e None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:40.893438 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c0434-8a79-45ea-91ca-8304db563d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:40.894245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c0434-8a79-45ea-91ca-8304db563d17 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:40.894523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c0434-8a79-45ea-91ca-8304db563d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:40.894793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c0434-8a79-45ea-91ca-8304db563d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:40.905572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c0434-8a79-45ea-91ca-8304db563d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:40.907043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c0434-8a79-45ea-91ca-8304db563d17 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:40.922870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-bd5c0434-8a79-45ea-91ca-8304db563d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:40.924047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 628/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:40.929939 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e69b-e2f7-46cf-8a05-ceb60a555e0d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:41.026593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075e69b-e2f7-46cf-8a05-ceb60a555e0d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:41.057809 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92a053-578c-4361-b02d-263629a06479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:41.058489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a053-578c-4361-b02d-263629a06479 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:41.058768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a053-578c-4361-b02d-263629a06479 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:41.059041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a053-578c-4361-b02d-263629a06479 None admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:41.059747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92a053-578c-4361-b02d-263629a06479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:41.060049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92a053-578c-4361-b02d-263629a06479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:41.061395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92a053-578c-4361-b02d-263629a06479 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:41.073172 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 651/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:39:41.078962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c0434-8a79-45ea-91ca-8304db563d17 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:41.175028 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c0434-8a79-45ea-91ca-8304db563d17 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:41.206996 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b50705-f7d6-47ff-b8a5-aa6cd7e319c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:41.207796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b50705-f7d6-47ff-b8a5-aa6cd7e319c6 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:41.208076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b50705-f7d6-47ff-b8a5-aa6cd7e319c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:41.208340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b50705-f7d6-47ff-b8a5-aa6cd7e319c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:41.215598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b50705-f7d6-47ff-b8a5-aa6cd7e319c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:41.217014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b50705-f7d6-47ff-b8a5-aa6cd7e319c6 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:41.230399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-02b50705-f7d6-47ff-b8a5-aa6cd7e319c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 28 21:39:41.231538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 629/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:41.237397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92a053-578c-4361-b02d-263629a06479 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:41.337902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92a053-578c-4361-b02d-263629a06479 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:41.371898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef331273-4f3f-4cd9-b3b7-0a5cb3de7511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:41.372582 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef331273-4f3f-4cd9-b3b7-0a5cb3de7511 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:41.372856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef331273-4f3f-4cd9-b3b7-0a5cb3de7511 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:41.373126 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef331273-4f3f-4cd9-b3b7-0a5cb3de7511 None admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:41.373948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef331273-4f3f-4cd9-b3b7-0a5cb3de7511 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:41.374288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef331273-4f3f-4cd9-b3b7-0a5cb3de7511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:41.375962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef331273-4f3f-4cd9-b3b7-0a5cb3de7511 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:41.393438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 652/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Mon Feb 28 21:39:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:41.399268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b50705-f7d6-47ff-b8a5-aa6cd7e319c6 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:41.494909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b50705-f7d6-47ff-b8a5-aa6cd7e319c6 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:41.526890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c9f89-c9e7-4b14-9094-b8ef29bbbf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:41.527524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c9f89-c9e7-4b14-9094-b8ef29bbbf7f None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:41.527796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c9f89-c9e7-4b14-9094-b8ef29bbbf7f None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:41.528063 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c9f89-c9e7-4b14-9094-b8ef29bbbf7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:41.592322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c9f89-c9e7-4b14-9094-b8ef29bbbf7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:41.593741 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c9f89-c9e7-4b14-9094-b8ef29bbbf7f None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:41.687813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 630/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Mon Feb 28 21:39:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Feb 28 21:39:41.693531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef331273-4f3f-4cd9-b3b7-0a5cb3de7511 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:41.788466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef331273-4f3f-4cd9-b3b7-0a5cb3de7511 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:41.820740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad43cd0-390a-47d6-a93a-d1ab2bce52c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:41.821533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad43cd0-390a-47d6-a93a-d1ab2bce52c0 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:41.821816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad43cd0-390a-47d6-a93a-d1ab2bce52c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:41.823203 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad43cd0-390a-47d6-a93a-d1ab2bce52c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:41.831927 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad43cd0-390a-47d6-a93a-d1ab2bce52c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:41.833509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad43cd0-390a-47d6-a93a-d1ab2bce52c0 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:41.850236 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-4ad43cd0-390a-47d6-a93a-d1ab2bce52c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 28 21:39:41.851398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 653/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:41.856995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c9f89-c9e7-4b14-9094-b8ef29bbbf7f None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:41.954388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c9f89-c9e7-4b14-9094-b8ef29bbbf7f None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:41.988365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70ac09-2041-42a8-957c-5b1161cd3133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:41.989024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70ac09-2041-42a8-957c-5b1161cd3133 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:41.989349 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70ac09-2041-42a8-957c-5b1161cd3133 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:41.989682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70ac09-2041-42a8-957c-5b1161cd3133 None admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:41.990579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70ac09-2041-42a8-957c-5b1161cd3133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:41.990884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70ac09-2041-42a8-957c-5b1161cd3133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:41.992273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70ac09-2041-42a8-957c-5b1161cd3133 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:42.003429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 631/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Mon Feb 28 21:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:42.009001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad43cd0-390a-47d6-a93a-d1ab2bce52c0 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:42.104336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad43cd0-390a-47d6-a93a-d1ab2bce52c0 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:42.136867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfb0d8-a264-4b07-9aa6-2f65512a2132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:42.137662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfb0d8-a264-4b07-9aa6-2f65512a2132 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:42.137949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfb0d8-a264-4b07-9aa6-2f65512a2132 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:42.138251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfb0d8-a264-4b07-9aa6-2f65512a2132 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:42.144822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfb0d8-a264-4b07-9aa6-2f65512a2132 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:42.146847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfb0d8-a264-4b07-9aa6-2f65512a2132 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:42.159605 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING keystone.server.flask.application [None req-0abfb0d8-a264-4b07-9aa6-2f65512a2132 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 28 21:39:42.160764 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 654/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Mon Feb 28 21:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:42.167325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70ac09-2041-42a8-957c-5b1161cd3133 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:42.262137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70ac09-2041-42a8-957c-5b1161cd3133 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:42.294336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571813d-32e8-4ddf-a9c6-1a59ecd102d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:42.294991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571813d-32e8-4ddf-a9c6-1a59ecd102d2 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:42.295269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571813d-32e8-4ddf-a9c6-1a59ecd102d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:42.295540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571813d-32e8-4ddf-a9c6-1a59ecd102d2 None admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:42.296324 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571813d-32e8-4ddf-a9c6-1a59ecd102d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:42.296626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571813d-32e8-4ddf-a9c6-1a59ecd102d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:42.298060 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571813d-32e8-4ddf-a9c6-1a59ecd102d2 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:42.309381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 632/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Mon Feb 28 21:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:42.315347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfb0d8-a264-4b07-9aa6-2f65512a2132 None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:42.412304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfb0d8-a264-4b07-9aa6-2f65512a2132 None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:42.444675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fbdc2-ce5d-42aa-963b-e3fbced4cb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:42.445312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fbdc2-ce5d-42aa-963b-e3fbced4cb72 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:42.445588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fbdc2-ce5d-42aa-963b-e3fbced4cb72 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:42.445855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fbdc2-ce5d-42aa-963b-e3fbced4cb72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:42.446695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fbdc2-ce5d-42aa-963b-e3fbced4cb72 None admin] RBAC: Adding query filter params (role.id=b3b7af4521ad4bff9d33a92f132b3598, scope.project.id=c6d5f76f1ecc444e90b82818ac55901b, user.id=1875af7b72b247c9a2b5e1f2b2fb1eaa) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:42.446999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fbdc2-ce5d-42aa-963b-e3fbced4cb72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:42.448477 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fbdc2-ce5d-42aa-963b-e3fbced4cb72 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:42.454069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 655/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Mon Feb 28 21:39:42 2022] GET /identity/v3/role_assignments?user.id=1875af7b72b247c9a2b5e1f2b2fb1eaa&scope.project.id=c6d5f76f1ecc444e90b82818ac55901b&role.id=b3b7af4521ad4bff9d33a92f132b3598 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:44.850082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86746b45-7179-4bdb-bf68-4374e1a31800 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:44.850655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86746b45-7179-4bdb-bf68-4374e1a31800 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:44.850655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86746b45-7179-4bdb-bf68-4374e1a31800 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:44.852415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 633/1288] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:39:44.857908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82163f-ebaa-436c-afc4-d09521397a86 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:44.858379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82163f-ebaa-436c-afc4-d09521397a86 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:44.858509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82163f-ebaa-436c-afc4-d09521397a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:44.875442 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ee82163f-ebaa-436c-afc4-d09521397a86 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:44.876638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ee82163f-ebaa-436c-afc4-d09521397a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:44.941368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 656/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Feb 28 21:39:44.964570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86746b45-7179-4bdb-bf68-4374e1a31800 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:45.061299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86746b45-7179-4bdb-bf68-4374e1a31800 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:45.093799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebd485-9633-49b4-83b2-de6b412bc8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:45.094622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd485-9633-49b4-83b2-de6b412bc8c7 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:45.094897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd485-9633-49b4-83b2-de6b412bc8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:45.095163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebd485-9633-49b4-83b2-de6b412bc8c7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:45.095802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebd485-9633-49b4-83b2-de6b412bc8c7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:45.097142 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebd485-9633-49b4-83b2-de6b412bc8c7 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:45.108126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-61ebd485-9633-49b4-83b2-de6b412bc8c7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 21:39:45.109212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 634/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Feb 28 21:39:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:45.115693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82163f-ebaa-436c-afc4-d09521397a86 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:45.209191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82163f-ebaa-436c-afc4-d09521397a86 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:45.241811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0a980-cf48-4325-a09e-97bb3db8a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:45.242533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a980-cf48-4325-a09e-97bb3db8a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:45.242814 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a980-cf48-4325-a09e-97bb3db8a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:45.243087 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0a980-cf48-4325-a09e-97bb3db8a1f1 None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:45.243828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a980-cf48-4325-a09e-97bb3db8a1f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:45.244125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a980-cf48-4325-a09e-97bb3db8a1f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:45.245463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0a980-cf48-4325-a09e-97bb3db8a1f1 None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:45.250345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 657/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Feb 28 21:39:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:45.256618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebd485-9633-49b4-83b2-de6b412bc8c7 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:45.353172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebd485-9633-49b4-83b2-de6b412bc8c7 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:45.385272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d023a-7fa3-4dec-a50c-13428ed63715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:45.385942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d023a-7fa3-4dec-a50c-13428ed63715 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:45.386239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d023a-7fa3-4dec-a50c-13428ed63715 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:45.386530 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d023a-7fa3-4dec-a50c-13428ed63715 None admin] PATH_INFO: `/v3/services` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:45.387218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d023a-7fa3-4dec-a50c-13428ed63715 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:45.387518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d023a-7fa3-4dec-a50c-13428ed63715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:45.388898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d023a-7fa3-4dec-a50c-13428ed63715 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:45.393207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 635/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Feb 28 21:39:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:47.691684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d930175-3956-4542-be28-2b157230506f None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:47.692233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d930175-3956-4542-be28-2b157230506f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:47.692233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d930175-3956-4542-be28-2b157230506f None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:47.694559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 658/1293] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:39:47.699704 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65e40f-0ea1-4ab7-b3dd-e1949db2b8e3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:47.700502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65e40f-0ea1-4ab7-b3dd-e1949db2b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:47.700502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65e40f-0ea1-4ab7-b3dd-e1949db2b8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:47.717978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9c65e40f-0ea1-4ab7-b3dd-e1949db2b8e3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:47.719181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9c65e40f-0ea1-4ab7-b3dd-e1949db2b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:47.783264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 636/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:39:47.806130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d930175-3956-4542-be28-2b157230506f None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:47.906371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d930175-3956-4542-be28-2b157230506f None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:47.937874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebb7df-ee3f-47ce-9248-acbbc2c7d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:47.938539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebb7df-ee3f-47ce-9248-acbbc2c7d6cc None admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:47.938813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebb7df-ee3f-47ce-9248-acbbc2c7d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:47.939079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebb7df-ee3f-47ce-9248-acbbc2c7d6cc None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:47.939797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebb7df-ee3f-47ce-9248-acbbc2c7d6cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:47.941133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebb7df-ee3f-47ce-9248-acbbc2c7d6cc None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:48.021801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 659/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Mon Feb 28 21:39:47 2022] POST /identity/v3/services => generated 246 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:39:50.404573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094440-1fd1-4598-96dc-6fa037164d3a None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:50.405100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094440-1fd1-4598-96dc-6fa037164d3a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:50.405100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094440-1fd1-4598-96dc-6fa037164d3a None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:50.406968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 637/1296] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:39:50.412215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd5438-9811-44cb-a486-d55937a947e6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:50.412660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd5438-9811-44cb-a486-d55937a947e6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:50.417557 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd5438-9811-44cb-a486-d55937a947e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:50.429571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ccbd5438-9811-44cb-a486-d55937a947e6 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:50.430774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ccbd5438-9811-44cb-a486-d55937a947e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:50.500330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 660/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:39:50.523187 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094440-1fd1-4598-96dc-6fa037164d3a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:50.623111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094440-1fd1-4598-96dc-6fa037164d3a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:50.656601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804761d-b090-4fce-90f3-cb8cdecacdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:50.657313 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804761d-b090-4fce-90f3-cb8cdecacdc4 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:50.657591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804761d-b090-4fce-90f3-cb8cdecacdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:50.657865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804761d-b090-4fce-90f3-cb8cdecacdc4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:50.658595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804761d-b090-4fce-90f3-cb8cdecacdc4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:50.660008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804761d-b090-4fce-90f3-cb8cdecacdc4 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:50.671935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-2804761d-b090-4fce-90f3-cb8cdecacdc4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 21:39:50.673077 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 638/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Feb 28 21:39:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:50.679945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd5438-9811-44cb-a486-d55937a947e6 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:50.778890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd5438-9811-44cb-a486-d55937a947e6 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:50.811011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8029b01-6c68-4ea5-bb75-d6bdfee0b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:50.811661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029b01-6c68-4ea5-bb75-d6bdfee0b25d None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:50.811937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029b01-6c68-4ea5-bb75-d6bdfee0b25d None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:50.812200 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029b01-6c68-4ea5-bb75-d6bdfee0b25d None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:50.812887 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8029b01-6c68-4ea5-bb75-d6bdfee0b25d None admin] RBAC: Adding query filter params (name=placement) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:50.813181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8029b01-6c68-4ea5-bb75-d6bdfee0b25d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:50.814607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8029b01-6c68-4ea5-bb75-d6bdfee0b25d None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:50.819467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 661/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Feb 28 21:39:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:50.825454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804761d-b090-4fce-90f3-cb8cdecacdc4 None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:50.930863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804761d-b090-4fce-90f3-cb8cdecacdc4 None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:50.966354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a078edb-8ed1-4ebe-9a2c-6a7f4612d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:50.967125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a078edb-8ed1-4ebe-9a2c-6a7f4612d332 None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:50.967398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a078edb-8ed1-4ebe-9a2c-6a7f4612d332 None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:50.967666 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a078edb-8ed1-4ebe-9a2c-6a7f4612d332 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:50.968466 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a078edb-8ed1-4ebe-9a2c-6a7f4612d332 None admin] RBAC: Adding query filter params (interface=public, service_id=ff5e00df168f4326a6bd6ca9504b2e48, region_id=RegionOne) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:50.968770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a078edb-8ed1-4ebe-9a2c-6a7f4612d332 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:50.970186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a078edb-8ed1-4ebe-9a2c-6a7f4612d332 None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:50.976872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 639/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Mon Feb 28 21:39:50 2022] GET /identity/v3/endpoints?service_id=ff5e00df168f4326a6bd6ca9504b2e48&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:50.982785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8029b01-6c68-4ea5-bb75-d6bdfee0b25d None admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:51.087103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8029b01-6c68-4ea5-bb75-d6bdfee0b25d None admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:51.122803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c9cbb-1807-41bd-94ea-bcd2ece89c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:51.123497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c9cbb-1807-41bd-94ea-bcd2ece89c1c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:51.123775 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c9cbb-1807-41bd-94ea-bcd2ece89c1c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:51.124045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c9cbb-1807-41bd-94ea-bcd2ece89c1c None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:51.124975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c9cbb-1807-41bd-94ea-bcd2ece89c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:51.126367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c9cbb-1807-41bd-94ea-bcd2ece89c1c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:51.133949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 662/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Mon Feb 28 21:39:50 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:39:53.433444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72d453-9177-4384-9297-9a43b1af4ca5 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:53.434055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72d453-9177-4384-9297-9a43b1af4ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:53.434055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72d453-9177-4384-9297-9a43b1af4ca5 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:53.435920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 640/1302] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:39:53.441034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbf5e-dc3e-445e-99be-2c7b002e509a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:53.441428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbf5e-dc3e-445e-99be-2c7b002e509a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:53.441583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbf5e-dc3e-445e-99be-2c7b002e509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:53.458466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-8fddbf5e-dc3e-445e-99be-2c7b002e509a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:39:53.459638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-8fddbf5e-dc3e-445e-99be-2c7b002e509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:39:53.522846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 663/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:39:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Feb 28 21:39:53.545460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72d453-9177-4384-9297-9a43b1af4ca5 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:53.642574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72d453-9177-4384-9297-9a43b1af4ca5 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:53.674169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c8e1d-a819-4eca-ae0d-3214e18d047c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:53.674944 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c8e1d-a819-4eca-ae0d-3214e18d047c None admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:53.675220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c8e1d-a819-4eca-ae0d-3214e18d047c None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:53.675487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c8e1d-a819-4eca-ae0d-3214e18d047c None admin] PATH_INFO: `/v3/services/placement` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:53.676120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c8e1d-a819-4eca-ae0d-3214e18d047c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:53.677496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c8e1d-a819-4eca-ae0d-3214e18d047c None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:53.688802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING keystone.server.flask.application [None req-d84c8e1d-a819-4eca-ae0d-3214e18d047c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 28 21:39:53.689871 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 641/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Mon Feb 28 21:39:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 28 21:39:53.696128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddbf5e-dc3e-445e-99be-2c7b002e509a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:53.789380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddbf5e-dc3e-445e-99be-2c7b002e509a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:53.821324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c645-d67b-4455-a616-c2fb44b6127c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:53.825468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c645-d67b-4455-a616-c2fb44b6127c None admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:53.825468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c645-d67b-4455-a616-c2fb44b6127c None admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:53.825468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c645-d67b-4455-a616-c2fb44b6127c None admin] PATH_INFO: `/v3/services` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:53.825468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033c645-d67b-4455-a616-c2fb44b6127c None admin] RBAC: Adding query filter params (name=placement) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:39:53.825468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033c645-d67b-4455-a616-c2fb44b6127c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:53.825468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033c645-d67b-4455-a616-c2fb44b6127c None admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:53.830725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 664/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Mon Feb 28 21:39:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:39:53.836595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c8e1d-a819-4eca-ae0d-3214e18d047c None admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:39:53.930594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c8e1d-a819-4eca-ae0d-3214e18d047c None admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:39:53.965023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b945e45-33b8-4849-8ce9-8276506747fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:39:53.965023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b945e45-33b8-4849-8ce9-8276506747fc None admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:39:53.965023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b945e45-33b8-4849-8ce9-8276506747fc None admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:39:53.965023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b945e45-33b8-4849-8ce9-8276506747fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:39:53.965432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b945e45-33b8-4849-8ce9-8276506747fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:39:53.965432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b945e45-33b8-4849-8ce9-8276506747fc None admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:39:54.056183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 642/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Mon Feb 28 21:39:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:47:36.773096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044d85-566b-4799-a287-75e225ceb41f None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:36.774883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044d85-566b-4799-a287-75e225ceb41f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:36.776068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044d85-566b-4799-a287-75e225ceb41f None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:36.786359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 665/1307] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:47:36 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:47:36.786594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543b1ee-0f0b-4a69-aff2-fa5ccb6f596c None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:36.787023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543b1ee-0f0b-4a69-aff2-fa5ccb6f596c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:36.787141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543b1ee-0f0b-4a69-aff2-fa5ccb6f596c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:36.861806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6543b1ee-0f0b-4a69-aff2-fa5ccb6f596c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:47:36.867061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6543b1ee-0f0b-4a69-aff2-fa5ccb6f596c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:36.973916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 643/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:47:36.998586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08044d85-566b-4799-a287-75e225ceb41f None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:47:37.000570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-08044d85-566b-4799-a287-75e225ceb41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:37.163849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08044d85-566b-4799-a287-75e225ceb41f None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:47:37.267618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f92bfe-2e44-4734-8bf2-cb3b35dd79e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:47:37.268329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f92bfe-2e44-4734-8bf2-cb3b35dd79e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:37.268617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f92bfe-2e44-4734-8bf2-cb3b35dd79e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:37.268894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f92bfe-2e44-4734-8bf2-cb3b35dd79e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:37.269616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f92bfe-2e44-4734-8bf2-cb3b35dd79e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:47:37.271346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING py.warnings [None req-97f92bfe-2e44-4734-8bf2-cb3b35dd79e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:47:37.271346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: warnings.warn(msg) Feb 28 21:47:37.271346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: Feb 28 21:47:37.272655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f92bfe-2e44-4734-8bf2-cb3b35dd79e1 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:47:37.293707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 666/1309] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:47:36 2022] GET /identity/v3/projects => generated 2553 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:47:39.658749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34985320-4136-4271-acf7-f00a1e7d78e0 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:39.659298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34985320-4136-4271-acf7-f00a1e7d78e0 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:39.659390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34985320-4136-4271-acf7-f00a1e7d78e0 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:39.661149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 644/1310] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:47:39.666667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74ca27-6b40-4f98-ac56-68b73cb255bc None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:39.667079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74ca27-6b40-4f98-ac56-68b73cb255bc None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:39.667244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74ca27-6b40-4f98-ac56-68b73cb255bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:39.744528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-5c74ca27-6b40-4f98-ac56-68b73cb255bc None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:47:39.745725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5c74ca27-6b40-4f98-ac56-68b73cb255bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:39.839630 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 667/1311] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:47:39.890185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a50e1-a988-4b58-961a-c9e417194cce None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:39.890470 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a50e1-a988-4b58-961a-c9e417194cce None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:39.890748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a50e1-a988-4b58-961a-c9e417194cce None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:39.892582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 645/1312] 10.222.0.26 () {54 vars in 964 bytes} [Mon Feb 28 21:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:47:39.898801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ff70b-c525-40e3-a4b8-5fb604ef4f39 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:39.900059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ff70b-c525-40e3-a4b8-5fb604ef4f39 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:39.900346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ff70b-c525-40e3-a4b8-5fb604ef4f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:39.980439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b33ff70b-c525-40e3-a4b8-5fb604ef4f39 None None] MFA Rules not processed for user `b4664710493b462bafae3908c582e9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:47:39.981822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b33ff70b-c525-40e3-a4b8-5fb604ef4f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:40.082158 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 668/1313] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Feb 28 21:47:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:47:40.085302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a50e1-a988-4b58-961a-c9e417194cce None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:47:40.087105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4c0a50e1-a988-4b58-961a-c9e417194cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:40.199586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a50e1-a988-4b58-961a-c9e417194cce None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:47:40.277250 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b70264-59a4-495f-a9fe-e5e5787cca77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:47:40.279364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b70264-59a4-495f-a9fe-e5e5787cca77 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:40.279364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b70264-59a4-495f-a9fe-e5e5787cca77 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:40.279364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b70264-59a4-495f-a9fe-e5e5787cca77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:40.280793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-34b70264-59a4-495f-a9fe-e5e5787cca77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:40.395848 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b70264-59a4-495f-a9fe-e5e5787cca77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:47:40.397365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b70264-59a4-495f-a9fe-e5e5787cca77 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:47:40.416990 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 646/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:47:43.046068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff548a-fe84-4f9d-9e4d-a70da73db525 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:43.046588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff548a-fe84-4f9d-9e4d-a70da73db525 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:43.046588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff548a-fe84-4f9d-9e4d-a70da73db525 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:43.048319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 669/1315] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:47:43.053688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8e11-0673-4e2a-9284-a21adcf9b2d1 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:43.054105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8e11-0673-4e2a-9284-a21adcf9b2d1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:43.054264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8e11-0673-4e2a-9284-a21adcf9b2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:43.120863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-428f8e11-0673-4e2a-9284-a21adcf9b2d1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:47:43.122099 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-428f8e11-0673-4e2a-9284-a21adcf9b2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:43.216933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 647/1316] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:47:43.255228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff548a-fe84-4f9d-9e4d-a70da73db525 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:47:43.256804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a6ff548a-fe84-4f9d-9e4d-a70da73db525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:43.358262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff548a-fe84-4f9d-9e4d-a70da73db525 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:47:43.429524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c803f-7a72-4242-b841-ef3f0f231e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:47:43.430224 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c803f-7a72-4242-b841-ef3f0f231e44 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:43.430509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c803f-7a72-4242-b841-ef3f0f231e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:43.430784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c803f-7a72-4242-b841-ef3f0f231e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:43.432428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e02c803f-7a72-4242-b841-ef3f0f231e44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:43.537060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c803f-7a72-4242-b841-ef3f0f231e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:47:43.538488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c803f-7a72-4242-b841-ef3f0f231e44 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:47:43.555316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 670/1317] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:47:46.347618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ffc88-07c3-4115-9fba-d97351c4aedb None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:46.348149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ffc88-07c3-4115-9fba-d97351c4aedb None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:46.348149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ffc88-07c3-4115-9fba-d97351c4aedb None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:46.350002 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 648/1318] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:47:46.355507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b91c9-7776-46fc-8b2e-bad90b2be320 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:46.355920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b91c9-7776-46fc-8b2e-bad90b2be320 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:46.356053 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b91c9-7776-46fc-8b2e-bad90b2be320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:46.418356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-c97b91c9-7776-46fc-8b2e-bad90b2be320 None None] MFA Rules not processed for user `da54df780f9b46fe86e8cbde5bc268ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:47:46.419539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c97b91c9-7776-46fc-8b2e-bad90b2be320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:46.509320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 671/1319] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:47:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:47:46.548446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ffc88-07c3-4115-9fba-d97351c4aedb None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:47:46.550117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-cc5ffc88-07c3-4115-9fba-d97351c4aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:46.659386 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ffc88-07c3-4115-9fba-d97351c4aedb None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:47:46.729558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff17f8-c33b-48d1-a130-4fb5b7da4dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:47:46.730233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff17f8-c33b-48d1-a130-4fb5b7da4dec service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:46.730516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff17f8-c33b-48d1-a130-4fb5b7da4dec service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:46.730790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff17f8-c33b-48d1-a130-4fb5b7da4dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:46.732406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-95ff17f8-c33b-48d1-a130-4fb5b7da4dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:46.837789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff17f8-c33b-48d1-a130-4fb5b7da4dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:47:46.839286 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff17f8-c33b-48d1-a130-4fb5b7da4dec service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:47:46.857311 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 649/1320] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:47:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:47:49.995278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc6cd-f1eb-4905-ac8a-61590e3fb4d6 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:49.995800 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc6cd-f1eb-4905-ac8a-61590e3fb4d6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:49.995800 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc6cd-f1eb-4905-ac8a-61590e3fb4d6 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:49.997665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 672/1321] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:47:50.003684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d955fb-7b1f-4784-b73d-a558bb9325a1 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:50.004211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d955fb-7b1f-4784-b73d-a558bb9325a1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:50.004308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d955fb-7b1f-4784-b73d-a558bb9325a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:50.067396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-34d955fb-7b1f-4784-b73d-a558bb9325a1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:47:50.068656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-34d955fb-7b1f-4784-b73d-a558bb9325a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:50.164610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 650/1322] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:47:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:47:50.219785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2485f-9ad0-4ee9-a481-f7c006c4398c None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:50.220064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2485f-9ad0-4ee9-a481-f7c006c4398c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:50.220340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2485f-9ad0-4ee9-a481-f7c006c4398c None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:50.222380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 673/1323] 10.222.0.26 () {54 vars in 964 bytes} [Mon Feb 28 21:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:47:50.228390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e972c5-ca2b-4af2-9e92-a0f336f40dca None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:50.228679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e972c5-ca2b-4af2-9e92-a0f336f40dca None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:50.228958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e972c5-ca2b-4af2-9e92-a0f336f40dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:50.301446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f8e972c5-ca2b-4af2-9e92-a0f336f40dca None None] MFA Rules not processed for user `b4664710493b462bafae3908c582e9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:47:50.302659 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f8e972c5-ca2b-4af2-9e92-a0f336f40dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:50.380090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 651/1324] 10.222.0.26 () {58 vars in 1061 bytes} [Mon Feb 28 21:47:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:47:50.389931 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2485f-9ad0-4ee9-a481-f7c006c4398c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:47:50.391559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e3b2485f-9ad0-4ee9-a481-f7c006c4398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:50.490163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2485f-9ad0-4ee9-a481-f7c006c4398c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:47:50.560855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215a5ae-528b-4ffa-b800-b7c2dd5eff4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:47:50.561489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215a5ae-528b-4ffa-b800-b7c2dd5eff4b service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:50.561766 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215a5ae-528b-4ffa-b800-b7c2dd5eff4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:50.562062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215a5ae-528b-4ffa-b800-b7c2dd5eff4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:50.563668 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9215a5ae-528b-4ffa-b800-b7c2dd5eff4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:50.668588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215a5ae-528b-4ffa-b800-b7c2dd5eff4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:47:50.670038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215a5ae-528b-4ffa-b800-b7c2dd5eff4b service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:47:50.687430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 674/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:47:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:47:54.535328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ea1f8-a6ee-4ed5-8651-59596bb44a0f None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:54.535937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ea1f8-a6ee-4ed5-8651-59596bb44a0f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:54.535937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ea1f8-a6ee-4ed5-8651-59596bb44a0f None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:54.537651 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 652/1326] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:47:54.543039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c83a1-9f18-4c00-b648-53828c1679b5 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:54.543475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c83a1-9f18-4c00-b648-53828c1679b5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:54.543594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c83a1-9f18-4c00-b648-53828c1679b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:54.607829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-728c83a1-9f18-4c00-b648-53828c1679b5 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:47:54.609002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-728c83a1-9f18-4c00-b648-53828c1679b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:54.702615 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 675/1327] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:47:54.739322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ea1f8-a6ee-4ed5-8651-59596bb44a0f None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:47:54.740881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c47ea1f8-a6ee-4ed5-8651-59596bb44a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:54.842920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ea1f8-a6ee-4ed5-8651-59596bb44a0f None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:47:54.916571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d9da5-651b-40e9-a81b-e47afd78768d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:47:54.917222 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d9da5-651b-40e9-a81b-e47afd78768d service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:54.917502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d9da5-651b-40e9-a81b-e47afd78768d service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:54.917780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d9da5-651b-40e9-a81b-e47afd78768d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:54.919459 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-cc4d9da5-651b-40e9-a81b-e47afd78768d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:55.025446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d9da5-651b-40e9-a81b-e47afd78768d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:47:55.026917 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d9da5-651b-40e9-a81b-e47afd78768d service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:47:55.044408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 653/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:47:57.433386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472becb8-dd6c-4e97-984c-6d474f2bad24 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:57.433915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472becb8-dd6c-4e97-984c-6d474f2bad24 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:57.433915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472becb8-dd6c-4e97-984c-6d474f2bad24 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:57.435741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 676/1329] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:47:57.440955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c964ac-1c29-4038-90fb-95a50e04d924 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:57.441361 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c964ac-1c29-4038-90fb-95a50e04d924 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:57.441511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c964ac-1c29-4038-90fb-95a50e04d924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:57.505631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-98c964ac-1c29-4038-90fb-95a50e04d924 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:47:57.506853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-98c964ac-1c29-4038-90fb-95a50e04d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:57.599603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 654/1330] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:47:57.636370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472becb8-dd6c-4e97-984c-6d474f2bad24 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:47:57.638022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-472becb8-dd6c-4e97-984c-6d474f2bad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:57.736576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472becb8-dd6c-4e97-984c-6d474f2bad24 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:47:57.806176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ffbae-e420-4152-aca1-be14c7392966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:47:57.806822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ffbae-e420-4152-aca1-be14c7392966 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:47:57.807102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ffbae-e420-4152-aca1-be14c7392966 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:47:57.807374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ffbae-e420-4152-aca1-be14c7392966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:47:57.808988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1f5ffbae-e420-4152-aca1-be14c7392966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:47:57.915910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ffbae-e420-4152-aca1-be14c7392966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:47:57.917345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ffbae-e420-4152-aca1-be14c7392966 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:47:57.935037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 677/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:00.306079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f09b-87b0-47e4-977f-00565b473786 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:00.306582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f09b-87b0-47e4-977f-00565b473786 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:00.306582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9f09b-87b0-47e4-977f-00565b473786 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:00.308301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 655/1332] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:00.313533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa82870-0282-49c4-9f7f-9369a259ecd6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:00.313947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa82870-0282-49c4-9f7f-9369a259ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:00.314111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa82870-0282-49c4-9f7f-9369a259ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:00.377086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-daa82870-0282-49c4-9f7f-9369a259ecd6 None None] MFA Rules not processed for user `da54df780f9b46fe86e8cbde5bc268ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:00.378309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-daa82870-0282-49c4-9f7f-9369a259ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:00.474476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 678/1333] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:48:00.513189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9f09b-87b0-47e4-977f-00565b473786 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:00.514782 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b4b9f09b-87b0-47e4-977f-00565b473786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:00.614118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9f09b-87b0-47e4-977f-00565b473786 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:00.684148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791ac40-fb1d-4b83-a57a-e54461af59be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:00.684792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791ac40-fb1d-4b83-a57a-e54461af59be service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:00.685070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791ac40-fb1d-4b83-a57a-e54461af59be service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:00.685343 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791ac40-fb1d-4b83-a57a-e54461af59be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:00.687000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c791ac40-fb1d-4b83-a57a-e54461af59be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:00.792177 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791ac40-fb1d-4b83-a57a-e54461af59be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:00.793608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791ac40-fb1d-4b83-a57a-e54461af59be service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:00.811057 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 656/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:03.685225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0014f-8d9a-42b4-b389-696436e8a33c None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:03.685801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0014f-8d9a-42b4-b389-696436e8a33c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:03.685801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0014f-8d9a-42b4-b389-696436e8a33c None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:03.687551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 679/1335] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:03.693073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce5154-b3ef-432a-b3b8-97977769da55 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:03.693516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce5154-b3ef-432a-b3b8-97977769da55 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:03.694013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce5154-b3ef-432a-b3b8-97977769da55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:03.763791 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-d8ce5154-b3ef-432a-b3b8-97977769da55 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:03.765014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d8ce5154-b3ef-432a-b3b8-97977769da55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:03.865813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 657/1336] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:03.902320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0014f-8d9a-42b4-b389-696436e8a33c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:03.903793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ccc0014f-8d9a-42b4-b389-696436e8a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:04.008330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0014f-8d9a-42b4-b389-696436e8a33c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:04.080453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c8256-3cc1-420f-b65e-0d4a6fc9e349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:04.081102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c8256-3cc1-420f-b65e-0d4a6fc9e349 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:04.081385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c8256-3cc1-420f-b65e-0d4a6fc9e349 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:04.081659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c8256-3cc1-420f-b65e-0d4a6fc9e349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:04.083321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3a2c8256-3cc1-420f-b65e-0d4a6fc9e349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:04.192043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c8256-3cc1-420f-b65e-0d4a6fc9e349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:04.193368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c8256-3cc1-420f-b65e-0d4a6fc9e349 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:04.211703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 680/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:06.591721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc746e4-6332-448c-80fd-6eb0085dbef3 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:06.592289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc746e4-6332-448c-80fd-6eb0085dbef3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:06.592289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc746e4-6332-448c-80fd-6eb0085dbef3 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:06.594066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 658/1338] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:06.599231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3fadb-0ce5-45b8-90ec-9152f9efea7e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:06.599693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3fadb-0ce5-45b8-90ec-9152f9efea7e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:06.599792 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3fadb-0ce5-45b8-90ec-9152f9efea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:06.663058 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2dd3fadb-0ce5-45b8-90ec-9152f9efea7e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:06.664247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2dd3fadb-0ce5-45b8-90ec-9152f9efea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:06.758628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 681/1339] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:06.798405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc746e4-6332-448c-80fd-6eb0085dbef3 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:06.801390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0cc746e4-6332-448c-80fd-6eb0085dbef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:06.917607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc746e4-6332-448c-80fd-6eb0085dbef3 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:06.930671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467bc32-f56c-411b-b68f-7b4578358afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:06.931319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467bc32-f56c-411b-b68f-7b4578358afd service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:06.931602 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467bc32-f56c-411b-b68f-7b4578358afd service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:06.931876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467bc32-f56c-411b-b68f-7b4578358afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:06.933520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e467bc32-f56c-411b-b68f-7b4578358afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:07.036546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467bc32-f56c-411b-b68f-7b4578358afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:07.038005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467bc32-f56c-411b-b68f-7b4578358afd service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:07.057646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 659/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:09.934847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a760325-446d-4835-9b58-b38cc98ded13 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:09.935397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a760325-446d-4835-9b58-b38cc98ded13 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:09.935397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a760325-446d-4835-9b58-b38cc98ded13 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:09.937146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 682/1341] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:09.942258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3af6-1c21-4405-848b-6d54376e1ff3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:09.942731 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3af6-1c21-4405-848b-6d54376e1ff3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:09.942833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3af6-1c21-4405-848b-6d54376e1ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:09.986707 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-068c3af6-1c21-4405-848b-6d54376e1ff3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:09.987883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-068c3af6-1c21-4405-848b-6d54376e1ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:10.064987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 660/1342] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:48:10.101498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a760325-446d-4835-9b58-b38cc98ded13 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:10.104740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3a760325-446d-4835-9b58-b38cc98ded13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:10.126316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a760325-446d-4835-9b58-b38cc98ded13 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:10.129735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55a9d5-9b3b-476e-bdd9-e7b83d3b41c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:10.130401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a9d5-9b3b-476e-bdd9-e7b83d3b41c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:10.130675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a9d5-9b3b-476e-bdd9-e7b83d3b41c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:10.130944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a9d5-9b3b-476e-bdd9-e7b83d3b41c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:10.139708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55a9d5-9b3b-476e-bdd9-e7b83d3b41c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:10.141109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55a9d5-9b3b-476e-bdd9-e7b83d3b41c0 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:10.150901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 683/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:15.040981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5a2c6-aa45-4307-b2c0-f3fbd42636dc None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:15.041527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5a2c6-aa45-4307-b2c0-f3fbd42636dc None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:15.041527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5a2c6-aa45-4307-b2c0-f3fbd42636dc None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:15.043347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 661/1344] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:15.048617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f573-cf8d-4bb4-84c1-a675d4a5e4b6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:15.049031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f573-cf8d-4bb4-84c1-a675d4a5e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:15.049174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0f573-cf8d-4bb4-84c1-a675d4a5e4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:15.077339 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-99d0f573-cf8d-4bb4-84c1-a675d4a5e4b6 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:15.078556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-99d0f573-cf8d-4bb4-84c1-a675d4a5e4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:15.086814 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 684/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:15.127667 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5a2c6-aa45-4307-b2c0-f3fbd42636dc None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:15.138774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5a2c6-aa45-4307-b2c0-f3fbd42636dc None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:15.142475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec9ad6-c765-4531-be33-407e96262cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:15.143104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec9ad6-c765-4531-be33-407e96262cbd service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:15.143382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec9ad6-c765-4531-be33-407e96262cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:15.143657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec9ad6-c765-4531-be33-407e96262cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:15.153044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec9ad6-c765-4531-be33-407e96262cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:15.154517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec9ad6-c765-4531-be33-407e96262cbd service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:15.164489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 662/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:48:18.418626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb04a3-a269-4643-8fe7-9a9c0515b6e9 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:18.419148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb04a3-a269-4643-8fe7-9a9c0515b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:18.419148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb04a3-a269-4643-8fe7-9a9c0515b6e9 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:18.420832 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 685/1347] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:18.426143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88609bd4-5f31-406d-b6e8-0a10e31c470d None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:18.426565 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88609bd4-5f31-406d-b6e8-0a10e31c470d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:18.426694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88609bd4-5f31-406d-b6e8-0a10e31c470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:18.445571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-88609bd4-5f31-406d-b6e8-0a10e31c470d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:18.446773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-88609bd4-5f31-406d-b6e8-0a10e31c470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:18.454575 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 663/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:48:18.492461 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb04a3-a269-4643-8fe7-9a9c0515b6e9 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:18.502849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb04a3-a269-4643-8fe7-9a9c0515b6e9 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:18.506415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b00425-c7f7-4c4e-b0be-c1d18030ed98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:18.507535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00425-c7f7-4c4e-b0be-c1d18030ed98 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:18.507818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00425-c7f7-4c4e-b0be-c1d18030ed98 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:18.508086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b00425-c7f7-4c4e-b0be-c1d18030ed98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:18.516723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b00425-c7f7-4c4e-b0be-c1d18030ed98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:18.518206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b00425-c7f7-4c4e-b0be-c1d18030ed98 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:18.527690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 686/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:23.187868 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebe86c-28b2-4729-8b45-118c10659c38 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:23.188445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebe86c-28b2-4729-8b45-118c10659c38 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:23.188445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebe86c-28b2-4729-8b45-118c10659c38 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:23.197874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 664/1350] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:23.198037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc5b39-08b7-4b7c-914c-400452f798cf None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:23.198037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc5b39-08b7-4b7c-914c-400452f798cf None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:23.198037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc5b39-08b7-4b7c-914c-400452f798cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:23.216891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-02dc5b39-08b7-4b7c-914c-400452f798cf None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:23.218131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-02dc5b39-08b7-4b7c-914c-400452f798cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:23.226884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 687/1351] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:23.265610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebe86c-28b2-4729-8b45-118c10659c38 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:23.277037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebe86c-28b2-4729-8b45-118c10659c38 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:23.280572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67089c2-2c61-4b6b-aaa3-ea2726c34ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:23.281206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67089c2-2c61-4b6b-aaa3-ea2726c34ffa service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:23.281483 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67089c2-2c61-4b6b-aaa3-ea2726c34ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:23.281749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67089c2-2c61-4b6b-aaa3-ea2726c34ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:23.290872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67089c2-2c61-4b6b-aaa3-ea2726c34ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:23.292287 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67089c2-2c61-4b6b-aaa3-ea2726c34ffa service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:23.301700 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 665/1352] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:28.607196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6aa09-6794-4f58-a5bd-f1cc97efc9ba None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:28.608012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6aa09-6794-4f58-a5bd-f1cc97efc9ba None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:28.608435 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6aa09-6794-4f58-a5bd-f1cc97efc9ba None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:28.611019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 688/1353] 10.222.0.26 () {54 vars in 921 bytes} [Mon Feb 28 21:48:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:28.616324 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15e1b5-d728-4c0f-b9f0-0904996a87ec None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:28.616786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15e1b5-d728-4c0f-b9f0-0904996a87ec None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:28.616894 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15e1b5-d728-4c0f-b9f0-0904996a87ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:28.689414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-4b15e1b5-d728-4c0f-b9f0-0904996a87ec None None] MFA Rules not processed for user `1875af7b72b247c9a2b5e1f2b2fb1eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:28.690847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4b15e1b5-d728-4c0f-b9f0-0904996a87ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:28.879875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 666/1354] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Feb 28 21:48:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:33.172001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d416-63f6-48d4-83bf-bdabe051e73f None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:33.172518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d416-63f6-48d4-83bf-bdabe051e73f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:33.172518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735d416-63f6-48d4-83bf-bdabe051e73f None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:33.174379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 689/1355] 10.222.0.26 () {54 vars in 921 bytes} [Mon Feb 28 21:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:33.179881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f18e0-e538-4bbd-b31f-3ee1e545f329 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:33.180792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f18e0-e538-4bbd-b31f-3ee1e545f329 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:33.181282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f18e0-e538-4bbd-b31f-3ee1e545f329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:33.200439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-895f18e0-e538-4bbd-b31f-3ee1e545f329 None None] MFA Rules not processed for user `1875af7b72b247c9a2b5e1f2b2fb1eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:33.201629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-895f18e0-e538-4bbd-b31f-3ee1e545f329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:33.210777 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 667/1356] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Feb 28 21:48:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:34.752850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb3631-0cda-4c11-9093-8d62e1090a56 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:34.753392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb3631-0cda-4c11-9093-8d62e1090a56 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:34.753551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb3631-0cda-4c11-9093-8d62e1090a56 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:34.755627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 690/1357] 10.222.0.26 () {54 vars in 921 bytes} [Mon Feb 28 21:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:48:34.761081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235e1a-fe0b-41cd-b264-f0d07cf4d30e None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:34.761520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235e1a-fe0b-41cd-b264-f0d07cf4d30e None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:34.761633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235e1a-fe0b-41cd-b264-f0d07cf4d30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:34.780834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ea235e1a-fe0b-41cd-b264-f0d07cf4d30e None None] MFA Rules not processed for user `1875af7b72b247c9a2b5e1f2b2fb1eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:34.782059 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ea235e1a-fe0b-41cd-b264-f0d07cf4d30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:34.791267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 668/1358] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Feb 28 21:48:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:48:38.776244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6e24-d9f5-43a8-90ed-f6c4348acb15 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:38.776853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6e24-d9f5-43a8-90ed-f6c4348acb15 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:38.777015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6e24-d9f5-43a8-90ed-f6c4348acb15 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:38.779238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 691/1359] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:38.784260 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc28869-a0bf-42de-b372-909827b74240 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:38.784662 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc28869-a0bf-42de-b372-909827b74240 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:38.784833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc28869-a0bf-42de-b372-909827b74240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:38.803034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9dc28869-a0bf-42de-b372-909827b74240 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:38.804193 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9dc28869-a0bf-42de-b372-909827b74240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:38.812398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 669/1360] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:38.864114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08e27-a9b5-492b-b663-7269d251fec5 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:38.864467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08e27-a9b5-492b-b663-7269d251fec5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:38.864876 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee08e27-a9b5-492b-b663-7269d251fec5 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:38.866771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 692/1361] 10.222.0.26 () {54 vars in 961 bytes} [Mon Feb 28 21:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:38.872326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7184dc2-0bbf-410c-99aa-6bd3ad0d83ee None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:38.875734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7184dc2-0bbf-410c-99aa-6bd3ad0d83ee None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:38.875734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7184dc2-0bbf-410c-99aa-6bd3ad0d83ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:38.922347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-c7184dc2-0bbf-410c-99aa-6bd3ad0d83ee None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:38.923810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c7184dc2-0bbf-410c-99aa-6bd3ad0d83ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:39.006826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 670/1362] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Feb 28 21:48:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:39.015030 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08e27-a9b5-492b-b663-7269d251fec5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:39.030266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee08e27-a9b5-492b-b663-7269d251fec5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:39.035861 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6d433-4fab-42e3-bc01-8af6cbad2cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:39.036638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d433-4fab-42e3-bc01-8af6cbad2cbc service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:39.036992 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d433-4fab-42e3-bc01-8af6cbad2cbc service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:39.037446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d433-4fab-42e3-bc01-8af6cbad2cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:39.045921 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6d433-4fab-42e3-bc01-8af6cbad2cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:39.047556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6d433-4fab-42e3-bc01-8af6cbad2cbc service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:39.056958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 693/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:41.625568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf69e07-8234-46e1-802e-c991b84c00ce None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:41.626121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf69e07-8234-46e1-802e-c991b84c00ce None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:41.626233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf69e07-8234-46e1-802e-c991b84c00ce None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:41.628084 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 671/1364] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:41.633334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7db64-7929-43cd-b25d-f23f4da5d450 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:41.633755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7db64-7929-43cd-b25d-f23f4da5d450 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:41.633892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7db64-7929-43cd-b25d-f23f4da5d450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:41.652540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-46d7db64-7929-43cd-b25d-f23f4da5d450 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:41.653783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-46d7db64-7929-43cd-b25d-f23f4da5d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:41.665143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 694/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:41.706308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf69e07-8234-46e1-802e-c991b84c00ce None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:41.721050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf69e07-8234-46e1-802e-c991b84c00ce None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:41.727543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0dc0-49c6-4d06-b57e-03836744f703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:41.728172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0dc0-49c6-4d06-b57e-03836744f703 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:41.728476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0dc0-49c6-4d06-b57e-03836744f703 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:41.728746 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0dc0-49c6-4d06-b57e-03836744f703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:41.737120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0dc0-49c6-4d06-b57e-03836744f703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:41.738716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0dc0-49c6-4d06-b57e-03836744f703 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:41.748008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 672/1366] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:44.605314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50482cf9-7dc0-43e9-92ca-128f6fd73540 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:44.605856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50482cf9-7dc0-43e9-92ca-128f6fd73540 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:44.605856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50482cf9-7dc0-43e9-92ca-128f6fd73540 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:44.607675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 695/1367] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:44.613378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3be07-d162-491b-97a0-d3501bf3b95b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:44.613800 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3be07-d162-491b-97a0-d3501bf3b95b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:44.613932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3be07-d162-491b-97a0-d3501bf3b95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:44.635218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-08f3be07-d162-491b-97a0-d3501bf3b95b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:44.636432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-08f3be07-d162-491b-97a0-d3501bf3b95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:44.644499 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 673/1368] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:44.693678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd5b7-b41d-4463-bdeb-f9b2d34b3def None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:44.693967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd5b7-b41d-4463-bdeb-f9b2d34b3def None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:44.694292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fd5b7-b41d-4463-bdeb-f9b2d34b3def None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:44.696088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 696/1369] 10.222.0.26 () {54 vars in 961 bytes} [Mon Feb 28 21:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:44.702499 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa4f7d-9299-475f-8fdd-2030a51de4ea None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:44.702939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa4f7d-9299-475f-8fdd-2030a51de4ea None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:44.703385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa4f7d-9299-475f-8fdd-2030a51de4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:44.722849 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-66fa4f7d-9299-475f-8fdd-2030a51de4ea None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:44.724820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-66fa4f7d-9299-475f-8fdd-2030a51de4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:44.742350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 674/1370] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Feb 28 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:44.743884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fd5b7-b41d-4463-bdeb-f9b2d34b3def None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:44.762521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fd5b7-b41d-4463-bdeb-f9b2d34b3def None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:44.768481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc0004-3f2e-4acc-a661-822bd71f52a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:44.769394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc0004-3f2e-4acc-a661-822bd71f52a0 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:44.769775 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc0004-3f2e-4acc-a661-822bd71f52a0 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:44.770195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc0004-3f2e-4acc-a661-822bd71f52a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:44.780430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc0004-3f2e-4acc-a661-822bd71f52a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:44.782134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc0004-3f2e-4acc-a661-822bd71f52a0 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:44.793221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 697/1371] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:47.086279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c103e-c3cc-4d7a-8481-fadd82c82ad8 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:47.086841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c103e-c3cc-4d7a-8481-fadd82c82ad8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:47.086841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c103e-c3cc-4d7a-8481-fadd82c82ad8 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:47.089013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 675/1372] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:47.095512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116edb2-a573-4041-86f8-8ba733b2bbf6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:47.096043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116edb2-a573-4041-86f8-8ba733b2bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:47.096338 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116edb2-a573-4041-86f8-8ba733b2bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:47.117760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-c116edb2-a573-4041-86f8-8ba733b2bbf6 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:47.117760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c116edb2-a573-4041-86f8-8ba733b2bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:47.126939 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 698/1373] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:47.442254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4004c5-7856-41df-9090-625eb1feedc9 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:47.442254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4004c5-7856-41df-9090-625eb1feedc9 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:47.442693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e867814-0981-46fa-b6af-ed008918dd8b None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:47.442693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e867814-0981-46fa-b6af-ed008918dd8b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:47.443069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4004c5-7856-41df-9090-625eb1feedc9 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:47.443159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e867814-0981-46fa-b6af-ed008918dd8b None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:47.444498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 676/1374] 10.222.0.26 () {54 vars in 963 bytes} [Mon Feb 28 21:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:47.444837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 699/1375] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:47.449887 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370752-31b7-4e89-b778-f1140f0b254b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:47.450059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c767bf5-7b64-4da8-be64-e2cc64320040 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:47.450320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c767bf5-7b64-4da8-be64-e2cc64320040 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:47.450420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370752-31b7-4e89-b778-f1140f0b254b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:47.450626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c767bf5-7b64-4da8-be64-e2cc64320040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:47.450744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370752-31b7-4e89-b778-f1140f0b254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:47.470243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-df370752-31b7-4e89-b778-f1140f0b254b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:47.471527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-df370752-31b7-4e89-b778-f1140f0b254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:47.480722 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 677/1376] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:47.501206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0c767bf5-7b64-4da8-be64-e2cc64320040 None None] MFA Rules not processed for user `ee8e7d47becf4c03967848eda8c311be`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:47.502717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0c767bf5-7b64-4da8-be64-e2cc64320040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:47.529109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df370752-31b7-4e89-b778-f1140f0b254b None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:47.541802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df370752-31b7-4e89-b778-f1140f0b254b None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:47.547507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d980050-00e4-423c-9b9b-6dc55fcc6b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:47.548151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d980050-00e4-423c-9b9b-6dc55fcc6b22 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:47.548434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d980050-00e4-423c-9b9b-6dc55fcc6b22 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:47.548703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d980050-00e4-423c-9b9b-6dc55fcc6b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:47.558143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d980050-00e4-423c-9b9b-6dc55fcc6b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:47.559919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d980050-00e4-423c-9b9b-6dc55fcc6b22 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:47.570493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 678/1377] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:48:47.571541 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 700/1378] 10.222.0.26 () {58 vars in 1060 bytes} [Mon Feb 28 21:48:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:47.580335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d980050-00e4-423c-9b9b-6dc55fcc6b22 service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:47.589488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d980050-00e4-423c-9b9b-6dc55fcc6b22 service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:47.604101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efab1ec-0cba-498e-bb5a-de8e7a4e0344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:47.604101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab1ec-0cba-498e-bb5a-de8e7a4e0344 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:47.604101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab1ec-0cba-498e-bb5a-de8e7a4e0344 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:47.604101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efab1ec-0cba-498e-bb5a-de8e7a4e0344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:47.604524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efab1ec-0cba-498e-bb5a-de8e7a4e0344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:47.605137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efab1ec-0cba-498e-bb5a-de8e7a4e0344 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:47.615214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 679/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:50.068645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f504e-784e-481b-9e10-eb5bb6341e2d None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:50.069169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f504e-784e-481b-9e10-eb5bb6341e2d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:50.069276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f504e-784e-481b-9e10-eb5bb6341e2d None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:50.070996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 701/1380] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:50.076462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efdc10-e830-47ab-b9f3-7a6bfa400142 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:50.076876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efdc10-e830-47ab-b9f3-7a6bfa400142 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:50.077009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efdc10-e830-47ab-b9f3-7a6bfa400142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:50.095811 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-e3efdc10-e830-47ab-b9f3-7a6bfa400142 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:50.096865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e3efdc10-e830-47ab-b9f3-7a6bfa400142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:50.105331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 680/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:50.150957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f504e-784e-481b-9e10-eb5bb6341e2d None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:50.168779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f504e-784e-481b-9e10-eb5bb6341e2d None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:50.175580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416b332-96e9-42f5-9b58-10f503ddbdc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:50.176576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416b332-96e9-42f5-9b58-10f503ddbdc4 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:50.176576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416b332-96e9-42f5-9b58-10f503ddbdc4 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:50.178412 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416b332-96e9-42f5-9b58-10f503ddbdc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:50.200986 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416b332-96e9-42f5-9b58-10f503ddbdc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:50.200986 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416b332-96e9-42f5-9b58-10f503ddbdc4 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:50.200986 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 702/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:52.683533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790349-e657-4229-a57c-cc539a5f251c None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:52.684088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790349-e657-4229-a57c-cc539a5f251c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:52.684088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790349-e657-4229-a57c-cc539a5f251c None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:52.685843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 681/1383] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:52.691199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660d83c-b10f-4f5b-8742-b1289ce99bfa None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:52.691988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660d83c-b10f-4f5b-8742-b1289ce99bfa None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:52.694727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660d83c-b10f-4f5b-8742-b1289ce99bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:52.713016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-9660d83c-b10f-4f5b-8742-b1289ce99bfa None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:52.714217 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9660d83c-b10f-4f5b-8742-b1289ce99bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:52.721957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 703/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:52.765437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790349-e657-4229-a57c-cc539a5f251c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:52.781150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790349-e657-4229-a57c-cc539a5f251c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:52.787847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db246119-c5db-48a3-ae18-92e5e407304b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:52.788878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db246119-c5db-48a3-ae18-92e5e407304b service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:52.789369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db246119-c5db-48a3-ae18-92e5e407304b service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:52.789861 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db246119-c5db-48a3-ae18-92e5e407304b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:52.798888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db246119-c5db-48a3-ae18-92e5e407304b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:52.800829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db246119-c5db-48a3-ae18-92e5e407304b service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:52.811238 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 682/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:55.405409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbfb9d-76ee-4ef0-a0fa-dfdbc3c41d28 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:55.405958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbfb9d-76ee-4ef0-a0fa-dfdbc3c41d28 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:55.406261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbfb9d-76ee-4ef0-a0fa-dfdbc3c41d28 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:55.408208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 704/1386] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:55.414626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0543d7f-e1a5-40a3-b25d-d9f3a7de5e70 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:55.415194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0543d7f-e1a5-40a3-b25d-d9f3a7de5e70 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:55.415194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0543d7f-e1a5-40a3-b25d-d9f3a7de5e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:55.434824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f0543d7f-e1a5-40a3-b25d-d9f3a7de5e70 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:55.436174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f0543d7f-e1a5-40a3-b25d-d9f3a7de5e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:55.445762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 683/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:48:55.487187 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbfb9d-76ee-4ef0-a0fa-dfdbc3c41d28 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:55.501806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbfb9d-76ee-4ef0-a0fa-dfdbc3c41d28 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:55.508010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe235af-17d7-4637-913c-1d89413145c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:55.508760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe235af-17d7-4637-913c-1d89413145c5 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:55.509142 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe235af-17d7-4637-913c-1d89413145c5 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:55.509512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe235af-17d7-4637-913c-1d89413145c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:55.518336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe235af-17d7-4637-913c-1d89413145c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:55.520021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe235af-17d7-4637-913c-1d89413145c5 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:55.530446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 705/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:48:58.086851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1e940-0fef-4066-b1e3-bcd1e1b88df0 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:58.087385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1e940-0fef-4066-b1e3-bcd1e1b88df0 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:58.087385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1e940-0fef-4066-b1e3-bcd1e1b88df0 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:58.089212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 684/1389] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:48:58.095627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fe4be-a9dd-4ebf-ba65-863a5bd13fa6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:58.096075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fe4be-a9dd-4ebf-ba65-863a5bd13fa6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:58.096167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fe4be-a9dd-4ebf-ba65-863a5bd13fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:58.114816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-980fe4be-a9dd-4ebf-ba65-863a5bd13fa6 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:48:58.115941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-980fe4be-a9dd-4ebf-ba65-863a5bd13fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:48:58.124209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 706/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:48:58.179765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1e940-0fef-4066-b1e3-bcd1e1b88df0 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:48:58.193750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1e940-0fef-4066-b1e3-bcd1e1b88df0 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:48:58.199240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b076fd-a497-43e2-abbc-fb463e3dc570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:48:58.199868 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b076fd-a497-43e2-abbc-fb463e3dc570 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:48:58.200147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b076fd-a497-43e2-abbc-fb463e3dc570 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:48:58.200420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b076fd-a497-43e2-abbc-fb463e3dc570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:48:58.209236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b076fd-a497-43e2-abbc-fb463e3dc570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:48:58.217135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b076fd-a497-43e2-abbc-fb463e3dc570 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:48:58.220643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 685/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:00.722762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112b639-9c5b-4aba-9bf7-848ff75bd669 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:00.724207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112b639-9c5b-4aba-9bf7-848ff75bd669 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:00.724207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112b639-9c5b-4aba-9bf7-848ff75bd669 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:00.725579 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 707/1392] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:00.731673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c0684-5569-4bef-bcf0-135b6377a654 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:00.732111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c0684-5569-4bef-bcf0-135b6377a654 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:00.732664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c0684-5569-4bef-bcf0-135b6377a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:00.757754 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8e7c0684-5569-4bef-bcf0-135b6377a654 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:00.759464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8e7c0684-5569-4bef-bcf0-135b6377a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:00.769762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 686/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:00.814894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112b639-9c5b-4aba-9bf7-848ff75bd669 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:00.831625 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112b639-9c5b-4aba-9bf7-848ff75bd669 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:00.837631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af98cad-bf0a-4084-b7b8-37e78184ed40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:00.838301 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af98cad-bf0a-4084-b7b8-37e78184ed40 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:00.838676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af98cad-bf0a-4084-b7b8-37e78184ed40 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:00.839042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af98cad-bf0a-4084-b7b8-37e78184ed40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:00.847170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af98cad-bf0a-4084-b7b8-37e78184ed40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:00.848771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af98cad-bf0a-4084-b7b8-37e78184ed40 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:00.858697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 708/1394] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:03.433183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224939-21ad-4bf4-8c10-69a9aeafd824 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:03.433792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224939-21ad-4bf4-8c10-69a9aeafd824 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:03.433792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224939-21ad-4bf4-8c10-69a9aeafd824 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:03.435556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 687/1395] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:03.441033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71ea2-5a62-4ac9-b60c-890648425e02 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:03.441470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71ea2-5a62-4ac9-b60c-890648425e02 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:03.441706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71ea2-5a62-4ac9-b60c-890648425e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:03.459502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-84c71ea2-5a62-4ac9-b60c-890648425e02 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:03.460697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-84c71ea2-5a62-4ac9-b60c-890648425e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:03.468505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 709/1396] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:03.512356 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20224939-21ad-4bf4-8c10-69a9aeafd824 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:03.527265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20224939-21ad-4bf4-8c10-69a9aeafd824 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:03.532524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78ec89-3cd4-40ba-b3e1-bb5b1bb99154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:03.533150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78ec89-3cd4-40ba-b3e1-bb5b1bb99154 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:03.533425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78ec89-3cd4-40ba-b3e1-bb5b1bb99154 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:03.533695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78ec89-3cd4-40ba-b3e1-bb5b1bb99154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:03.542404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78ec89-3cd4-40ba-b3e1-bb5b1bb99154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:03.543975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78ec89-3cd4-40ba-b3e1-bb5b1bb99154 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:03.553945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 688/1397] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:03.938933 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3949-5939-441d-9130-967734459ade None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:03.939151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3949-5939-441d-9130-967734459ade None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:03.939405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce3949-5939-441d-9130-967734459ade None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:03.941221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 710/1398] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:03.947891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4701a3c-af77-453e-a90b-e295d43fb6f7 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:03.948400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4701a3c-af77-453e-a90b-e295d43fb6f7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:03.948687 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4701a3c-af77-453e-a90b-e295d43fb6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:03.967877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a4701a3c-af77-453e-a90b-e295d43fb6f7 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:03.969078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a4701a3c-af77-453e-a90b-e295d43fb6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:03.977262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 689/1399] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:04.036626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a280-c79a-4ee2-8a30-22065acbf036 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:04.036916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a280-c79a-4ee2-8a30-22065acbf036 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:04.037195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a280-c79a-4ee2-8a30-22065acbf036 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:04.039022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 711/1400] 10.222.0.26 () {54 vars in 962 bytes} [Mon Feb 28 21:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:04.044179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50fef-1de6-4ff4-a17f-7820b85e9ae7 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:04.044462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50fef-1de6-4ff4-a17f-7820b85e9ae7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:04.044737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab50fef-1de6-4ff4-a17f-7820b85e9ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:04.092640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-2ab50fef-1de6-4ff4-a17f-7820b85e9ae7 None None] MFA Rules not processed for user `500eaf6aadff441ca1e535443e1d8c03`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:04.093816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2ab50fef-1de6-4ff4-a17f-7820b85e9ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:04.152275 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 690/1401] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Feb 28 21:49:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:04.160149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a280-c79a-4ee2-8a30-22065acbf036 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:04.170771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a280-c79a-4ee2-8a30-22065acbf036 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:04.174284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a1caf-9090-4775-b593-09f34a4d7a33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500eaf6aadff441ca1e535443e1d8c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:04.174945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a1caf-9090-4775-b593-09f34a4d7a33 service glance] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:04.175226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a1caf-9090-4775-b593-09f34a4d7a33 service glance] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:04.175498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a1caf-9090-4775-b593-09f34a4d7a33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:04.185279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a1caf-9090-4775-b593-09f34a4d7a33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:04.186727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a1caf-9090-4775-b593-09f34a4d7a33 service glance] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:04.197031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 712/1402] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:04.774730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1616-42e2-4aeb-bf86-75688431f3c1 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:04.775214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1616-42e2-4aeb-bf86-75688431f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:04.775394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed1616-42e2-4aeb-bf86-75688431f3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:04.823859 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f7ed1616-42e2-4aeb-bf86-75688431f3c1 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:04.825056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f7ed1616-42e2-4aeb-bf86-75688431f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:04.890832 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 691/1403] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 21:49:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:04.935086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a35a6-d0cf-445f-9ef4-4dcae9c48f75 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:04.935600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a35a6-d0cf-445f-9ef4-4dcae9c48f75 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:04.935711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a35a6-d0cf-445f-9ef4-4dcae9c48f75 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:04.937470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 713/1404] 10.222.0.26 () {54 vars in 942 bytes} [Mon Feb 28 21:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:49:04.945244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc952c6-9425-46ef-a10b-656f3cd62df8 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:04.945543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc952c6-9425-46ef-a10b-656f3cd62df8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:04.945820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc952c6-9425-46ef-a10b-656f3cd62df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:04.993071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-cbc952c6-9425-46ef-a10b-656f3cd62df8 None None] MFA Rules not processed for user `368937ee42184e31b346ab9db570c122`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:04.994307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-cbc952c6-9425-46ef-a10b-656f3cd62df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:05.063961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 692/1405] 10.222.0.26 () {58 vars in 1039 bytes} [Mon Feb 28 21:49:04 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:05.074210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a35a6-d0cf-445f-9ef4-4dcae9c48f75 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:05.087609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a35a6-d0cf-445f-9ef4-4dcae9c48f75 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:05.092572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409ee32-a976-46d9-a4aa-d8e19b047a19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:05.093280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ee32-a976-46d9-a4aa-d8e19b047a19 service swift] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:05.093645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ee32-a976-46d9-a4aa-d8e19b047a19 service swift] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:05.094003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409ee32-a976-46d9-a4aa-d8e19b047a19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:05.102230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409ee32-a976-46d9-a4aa-d8e19b047a19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:05.103872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409ee32-a976-46d9-a4aa-d8e19b047a19 service swift] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:05.112238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 714/1406] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 21:49:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 21:49:06.076696 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255e4e-8a92-4fb2-ab6a-5b4224c43ca4 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:06.077267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255e4e-8a92-4fb2-ab6a-5b4224c43ca4 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:06.077267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0255e4e-8a92-4fb2-ab6a-5b4224c43ca4 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:06.079062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 693/1407] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:06.088016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470567e3-ece8-4c7f-b6bd-daf2f2779773 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:06.088950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470567e3-ece8-4c7f-b6bd-daf2f2779773 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:06.089299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470567e3-ece8-4c7f-b6bd-daf2f2779773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:06.110437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-470567e3-ece8-4c7f-b6bd-daf2f2779773 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:06.111713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-470567e3-ece8-4c7f-b6bd-daf2f2779773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:06.130032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 715/1408] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:06.166420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0255e4e-8a92-4fb2-ab6a-5b4224c43ca4 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:06.183607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0255e4e-8a92-4fb2-ab6a-5b4224c43ca4 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:06.197076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb6af7-a1cc-42cb-9981-969ff027c71c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:06.197076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb6af7-a1cc-42cb-9981-969ff027c71c service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:06.197076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb6af7-a1cc-42cb-9981-969ff027c71c service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:06.197076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb6af7-a1cc-42cb-9981-969ff027c71c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:06.205462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb6af7-a1cc-42cb-9981-969ff027c71c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:06.207747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb6af7-a1cc-42cb-9981-969ff027c71c service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:06.217864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 694/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:09.043212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ac9a9-3bb1-4758-9375-92fe20414df4 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:09.043773 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ac9a9-3bb1-4758-9375-92fe20414df4 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:09.043773 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ac9a9-3bb1-4758-9375-92fe20414df4 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:09.049251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 716/1410] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:09.051626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004c45-9b42-42b5-bfb8-8845bdcd4bff None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:09.052477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004c45-9b42-42b5-bfb8-8845bdcd4bff None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:09.052753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004c45-9b42-42b5-bfb8-8845bdcd4bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:09.072417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9d004c45-9b42-42b5-bfb8-8845bdcd4bff None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:09.073628 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9d004c45-9b42-42b5-bfb8-8845bdcd4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:09.081437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 695/1411] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:09.126901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ac9a9-3bb1-4758-9375-92fe20414df4 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:09.145419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ac9a9-3bb1-4758-9375-92fe20414df4 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:09.151061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac7715-a379-40d7-a612-e839b07f2a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:09.151707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7715-a379-40d7-a612-e839b07f2a7a service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:09.151988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7715-a379-40d7-a612-e839b07f2a7a service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:09.152266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7715-a379-40d7-a612-e839b07f2a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:09.160897 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac7715-a379-40d7-a612-e839b07f2a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:09.162505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac7715-a379-40d7-a612-e839b07f2a7a service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:09.172924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 717/1412] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:30.008736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced5e4e-db1f-41fe-af9f-8b91117b07db None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:30.009345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced5e4e-db1f-41fe-af9f-8b91117b07db None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:30.009345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced5e4e-db1f-41fe-af9f-8b91117b07db None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:30.011128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 696/1413] 10.222.0.26 () {54 vars in 918 bytes} [Mon Feb 28 21:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:49:30.016391 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769644d8-e826-4683-845f-6bea214f7453 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:30.016825 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769644d8-e826-4683-845f-6bea214f7453 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:30.016955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769644d8-e826-4683-845f-6bea214f7453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:30.035311 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-769644d8-e826-4683-845f-6bea214f7453 None None] MFA Rules not processed for user `1875af7b72b247c9a2b5e1f2b2fb1eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:30.036482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-769644d8-e826-4683-845f-6bea214f7453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:30.044697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 718/1414] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Feb 28 21:49:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:30.059094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc912079-556f-46c9-954b-e80d30a8a506 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:30.059380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc912079-556f-46c9-954b-e80d30a8a506 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:30.059653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc912079-556f-46c9-954b-e80d30a8a506 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:30.061422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 697/1415] 10.222.0.26 () {54 vars in 918 bytes} [Mon Feb 28 21:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:30.066104 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34172c-ca9e-48b0-b335-ea709c83676b None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:30.066385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34172c-ca9e-48b0-b335-ea709c83676b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:30.066657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34172c-ca9e-48b0-b335-ea709c83676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:30.083952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2c34172c-ca9e-48b0-b335-ea709c83676b None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:30.085115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2c34172c-ca9e-48b0-b335-ea709c83676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:30.094038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 719/1416] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Feb 28 21:49:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:32.823793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084c1a7-7fac-47fb-a280-9b5e2ac8d0ac None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:32.824319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084c1a7-7fac-47fb-a280-9b5e2ac8d0ac None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:32.824319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084c1a7-7fac-47fb-a280-9b5e2ac8d0ac None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:32.826167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:32.831583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2758e06-3ab3-48d8-94e6-05d7d71a36f9 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:32.832036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2758e06-3ab3-48d8-94e6-05d7d71a36f9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:32.832138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2758e06-3ab3-48d8-94e6-05d7d71a36f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:32.850405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d2758e06-3ab3-48d8-94e6-05d7d71a36f9 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:32.851589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d2758e06-3ab3-48d8-94e6-05d7d71a36f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:32.859562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:49:32.901505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084c1a7-7fac-47fb-a280-9b5e2ac8d0ac None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:32.915799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084c1a7-7fac-47fb-a280-9b5e2ac8d0ac None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:32.921108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bf9d1-ef39-4b7c-867f-f08e104bba5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:32.921726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf9d1-ef39-4b7c-867f-f08e104bba5d service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:32.922028 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf9d1-ef39-4b7c-867f-f08e104bba5d service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:32.922303 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf9d1-ef39-4b7c-867f-f08e104bba5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:32.931633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bf9d1-ef39-4b7c-867f-f08e104bba5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:32.933214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bf9d1-ef39-4b7c-867f-f08e104bba5d service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:32.943123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 699/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:34.344392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaed637-7a3c-4b94-857a-c660f645780f None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:34.345055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaed637-7a3c-4b94-857a-c660f645780f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:34.345055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaed637-7a3c-4b94-857a-c660f645780f None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:34.347483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:34.352506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f30f7-a631-4032-9267-3c929f8c28c7 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:34.352938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f30f7-a631-4032-9267-3c929f8c28c7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:34.353037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f30f7-a631-4032-9267-3c929f8c28c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:34.370904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-042f30f7-a631-4032-9267-3c929f8c28c7 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:34.372092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-042f30f7-a631-4032-9267-3c929f8c28c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:34.380909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:34.541877 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaed637-7a3c-4b94-857a-c660f645780f None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:34.555862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaed637-7a3c-4b94-857a-c660f645780f None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:34.562634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d7abe-7ac0-45bb-9c2a-10614c2fc2a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:34.563269 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d7abe-7ac0-45bb-9c2a-10614c2fc2a2 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:34.563565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d7abe-7ac0-45bb-9c2a-10614c2fc2a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:34.563824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d7abe-7ac0-45bb-9c2a-10614c2fc2a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:34.573706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d7abe-7ac0-45bb-9c2a-10614c2fc2a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:34.575311 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d7abe-7ac0-45bb-9c2a-10614c2fc2a2 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:34.585492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 722/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:35.904457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c60a-9c81-4375-9e73-f85ec190c85c None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:35.904943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c60a-9c81-4375-9e73-f85ec190c85c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:35.905037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c60a-9c81-4375-9e73-f85ec190c85c None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:35.906826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:35.912016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4fc93-34e5-45b3-968a-c39bdfe95c2d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:35.912470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4fc93-34e5-45b3-968a-c39bdfe95c2d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:35.912585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4fc93-34e5-45b3-968a-c39bdfe95c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:35.930522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-49c4fc93-34e5-45b3-968a-c39bdfe95c2d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:35.931711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-49c4fc93-34e5-45b3-968a-c39bdfe95c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:35.939452 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:36.087737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8c60a-9c81-4375-9e73-f85ec190c85c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:36.102486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8c60a-9c81-4375-9e73-f85ec190c85c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:36.108322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94369d-63fe-4e49-b6b9-b8566fb3398e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:36.108892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94369d-63fe-4e49-b6b9-b8566fb3398e service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:36.109171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94369d-63fe-4e49-b6b9-b8566fb3398e service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:36.109445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94369d-63fe-4e49-b6b9-b8566fb3398e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:36.118565 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94369d-63fe-4e49-b6b9-b8566fb3398e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:36.120135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94369d-63fe-4e49-b6b9-b8566fb3398e service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:36.129442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 702/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:37.432706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de848633-31cd-40fd-a0ff-2c14d352e96e None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:37.433279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de848633-31cd-40fd-a0ff-2c14d352e96e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:37.433279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de848633-31cd-40fd-a0ff-2c14d352e96e None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:37.435045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:37.442306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c122-83d6-478e-8b58-42f6d9b07dba None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:37.442726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c122-83d6-478e-8b58-42f6d9b07dba None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:37.442835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c122-83d6-478e-8b58-42f6d9b07dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:37.461252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-06d6c122-83d6-478e-8b58-42f6d9b07dba None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:37.462480 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-06d6c122-83d6-478e-8b58-42f6d9b07dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:37.470277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:37.620062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de848633-31cd-40fd-a0ff-2c14d352e96e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:37.634559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de848633-31cd-40fd-a0ff-2c14d352e96e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:37.639760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90708f-b0cc-46ea-9fb6-266116cc7cb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:37.640382 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90708f-b0cc-46ea-9fb6-266116cc7cb6 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:37.640660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90708f-b0cc-46ea-9fb6-266116cc7cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:37.640926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90708f-b0cc-46ea-9fb6-266116cc7cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:37.649459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90708f-b0cc-46ea-9fb6-266116cc7cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:37.651046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90708f-b0cc-46ea-9fb6-266116cc7cb6 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:37.660195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 725/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:38.976977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3809c47-cde3-4408-964f-fe8e0e443390 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:38.977542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3809c47-cde3-4408-964f-fe8e0e443390 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:38.977542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3809c47-cde3-4408-964f-fe8e0e443390 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:38.979373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:38.984721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624011d2-7e16-4f4f-875c-337e750e4c30 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:38.985149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624011d2-7e16-4f4f-875c-337e750e4c30 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:38.985274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624011d2-7e16-4f4f-875c-337e750e4c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:39.003855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-624011d2-7e16-4f4f-875c-337e750e4c30 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:39.005023 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-624011d2-7e16-4f4f-875c-337e750e4c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:39.012738 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:39.163460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3809c47-cde3-4408-964f-fe8e0e443390 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:39.178011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3809c47-cde3-4408-964f-fe8e0e443390 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:39.183870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec83b6-0f73-4d99-9938-578253ca0229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:39.184495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec83b6-0f73-4d99-9938-578253ca0229 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:39.184774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec83b6-0f73-4d99-9938-578253ca0229 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:39.185047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec83b6-0f73-4d99-9938-578253ca0229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:39.192901 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec83b6-0f73-4d99-9938-578253ca0229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:39.194509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec83b6-0f73-4d99-9938-578253ca0229 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:39.203575 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 705/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:40.524737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db096b1d-8dce-4cbd-8700-451c7f15c933 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:40.525253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db096b1d-8dce-4cbd-8700-451c7f15c933 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:40.525253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db096b1d-8dce-4cbd-8700-451c7f15c933 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:40.527054 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:40.531965 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468e143-c20f-4f83-b39d-dad1afadd8f9 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:40.532379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468e143-c20f-4f83-b39d-dad1afadd8f9 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:40.532527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468e143-c20f-4f83-b39d-dad1afadd8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:40.551309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-7468e143-c20f-4f83-b39d-dad1afadd8f9 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:40.552505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7468e143-c20f-4f83-b39d-dad1afadd8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:40.560272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:40.716538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db096b1d-8dce-4cbd-8700-451c7f15c933 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:40.731309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db096b1d-8dce-4cbd-8700-451c7f15c933 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:40.737254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379017e-71b1-49f4-920a-badcf76bf968 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:40.737974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379017e-71b1-49f4-920a-badcf76bf968 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:40.738278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379017e-71b1-49f4-920a-badcf76bf968 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:40.738551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379017e-71b1-49f4-920a-badcf76bf968 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:40.746335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379017e-71b1-49f4-920a-badcf76bf968 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:40.747898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379017e-71b1-49f4-920a-badcf76bf968 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:40.757018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 728/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:42.083070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8441d-a2a7-4736-b20e-e705ae582fdc None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:42.083621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8441d-a2a7-4736-b20e-e705ae582fdc None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:42.083621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8441d-a2a7-4736-b20e-e705ae582fdc None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:42.085471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:42.090600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc020-1461-4666-8012-3b5d6619aa7a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:42.091017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc020-1461-4666-8012-3b5d6619aa7a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:42.091141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc020-1461-4666-8012-3b5d6619aa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:42.109607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-762cc020-1461-4666-8012-3b5d6619aa7a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:42.110773 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-762cc020-1461-4666-8012-3b5d6619aa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:42.118767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:42.281081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8441d-a2a7-4736-b20e-e705ae582fdc None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:42.295123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8441d-a2a7-4736-b20e-e705ae582fdc None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:42.301110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535ee8c-18d5-476d-8c15-a687035cc3ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:42.301734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535ee8c-18d5-476d-8c15-a687035cc3ec service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:42.302044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535ee8c-18d5-476d-8c15-a687035cc3ec service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:42.302326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535ee8c-18d5-476d-8c15-a687035cc3ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:42.310188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535ee8c-18d5-476d-8c15-a687035cc3ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:42.311762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535ee8c-18d5-476d-8c15-a687035cc3ec service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:42.321496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 708/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:49:43.640221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f396e9e-a4f7-4e58-9fe9-abf6b28e3739 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:43.640794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f396e9e-a4f7-4e58-9fe9-abf6b28e3739 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:43.640794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f396e9e-a4f7-4e58-9fe9-abf6b28e3739 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:43.643186 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:43.648141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db56746-d4de-455f-8fde-b8bf2875be2f None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:43.648597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db56746-d4de-455f-8fde-b8bf2875be2f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:43.648698 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db56746-d4de-455f-8fde-b8bf2875be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:43.666984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6db56746-d4de-455f-8fde-b8bf2875be2f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:43.668167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6db56746-d4de-455f-8fde-b8bf2875be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:43.676165 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:43.826428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f396e9e-a4f7-4e58-9fe9-abf6b28e3739 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:43.841196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f396e9e-a4f7-4e58-9fe9-abf6b28e3739 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:43.847313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ad601-5f34-48cd-a46b-b32ce8705480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:43.847944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ad601-5f34-48cd-a46b-b32ce8705480 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:43.848229 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ad601-5f34-48cd-a46b-b32ce8705480 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:43.848506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ad601-5f34-48cd-a46b-b32ce8705480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:43.857013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ad601-5f34-48cd-a46b-b32ce8705480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:43.858648 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ad601-5f34-48cd-a46b-b32ce8705480 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:43.868173 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 731/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:45.228764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249180e-53ae-4c8c-9bce-c9fcc63a2381 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:45.229332 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249180e-53ae-4c8c-9bce-c9fcc63a2381 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:45.229332 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249180e-53ae-4c8c-9bce-c9fcc63a2381 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:45.231399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:45.237121 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81439d49-d1e8-4795-8312-03d5ec9b9992 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:45.237532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81439d49-d1e8-4795-8312-03d5ec9b9992 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:45.237696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81439d49-d1e8-4795-8312-03d5ec9b9992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:45.256340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-81439d49-d1e8-4795-8312-03d5ec9b9992 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:45.257517 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-81439d49-d1e8-4795-8312-03d5ec9b9992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:45.265177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:45.416098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249180e-53ae-4c8c-9bce-c9fcc63a2381 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:45.430464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249180e-53ae-4c8c-9bce-c9fcc63a2381 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:45.435671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ab87b-72ae-41fb-a1af-e25dd1d25915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:45.436290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ab87b-72ae-41fb-a1af-e25dd1d25915 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:45.436570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ab87b-72ae-41fb-a1af-e25dd1d25915 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:45.436842 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ab87b-72ae-41fb-a1af-e25dd1d25915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:45.445340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ab87b-72ae-41fb-a1af-e25dd1d25915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:45.446933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ab87b-72ae-41fb-a1af-e25dd1d25915 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:45.456300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 711/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:47.632767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1ad89-d132-48ab-a7c7-e399e1994d9e None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:47.633336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1ad89-d132-48ab-a7c7-e399e1994d9e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:47.633336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1ad89-d132-48ab-a7c7-e399e1994d9e None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:47.635096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:47.640486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f31c6-8d67-4a99-8cbc-c0f50fb7c879 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:47.640878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f31c6-8d67-4a99-8cbc-c0f50fb7c879 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:47.641039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f31c6-8d67-4a99-8cbc-c0f50fb7c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:47.659813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-fd3f31c6-8d67-4a99-8cbc-c0f50fb7c879 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:47.660981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fd3f31c6-8d67-4a99-8cbc-c0f50fb7c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:47.668660 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:47.707390 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1ad89-d132-48ab-a7c7-e399e1994d9e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:47.717706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1ad89-d132-48ab-a7c7-e399e1994d9e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:47.721491 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bea056-8034-41ea-af24-58f0422b5102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:47.722146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bea056-8034-41ea-af24-58f0422b5102 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:47.722426 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bea056-8034-41ea-af24-58f0422b5102 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:47.722700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bea056-8034-41ea-af24-58f0422b5102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:47.731563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bea056-8034-41ea-af24-58f0422b5102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:47.732978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bea056-8034-41ea-af24-58f0422b5102 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:47.743057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 734/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:50.211043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64411ba6-2c1d-4325-b5a8-9d7c513846bf None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:50.211555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64411ba6-2c1d-4325-b5a8-9d7c513846bf None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:50.211555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64411ba6-2c1d-4325-b5a8-9d7c513846bf None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:50.213279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:50.218589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e79d9-c345-44f9-aff7-7b8c2c1d14d6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:50.218995 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e79d9-c345-44f9-aff7-7b8c2c1d14d6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:50.219151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e79d9-c345-44f9-aff7-7b8c2c1d14d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:50.239040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-594e79d9-c345-44f9-aff7-7b8c2c1d14d6 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:50.240229 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-594e79d9-c345-44f9-aff7-7b8c2c1d14d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:50.248002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:50.286051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64411ba6-2c1d-4325-b5a8-9d7c513846bf None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:50.296490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64411ba6-2c1d-4325-b5a8-9d7c513846bf None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:50.301271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450ba6f-c8ad-4740-a6a4-c5bdea0df884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:50.301903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450ba6f-c8ad-4740-a6a4-c5bdea0df884 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:50.302226 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450ba6f-c8ad-4740-a6a4-c5bdea0df884 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:50.302497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450ba6f-c8ad-4740-a6a4-c5bdea0df884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:50.311468 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450ba6f-c8ad-4740-a6a4-c5bdea0df884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:50.312892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450ba6f-c8ad-4740-a6a4-c5bdea0df884 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:50.322994 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 714/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:52.939148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ff710-cf14-4c2d-a35a-91323049a1fd None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:52.939670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ff710-cf14-4c2d-a35a-91323049a1fd None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:52.939670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ff710-cf14-4c2d-a35a-91323049a1fd None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:52.941492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:52.946999 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a7f3-cb97-4b33-b5f6-a899733e8157 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:52.947431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a7f3-cb97-4b33-b5f6-a899733e8157 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:52.947527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1a7f3-cb97-4b33-b5f6-a899733e8157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:52.965498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-98f1a7f3-cb97-4b33-b5f6-a899733e8157 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:52.971057 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-98f1a7f3-cb97-4b33-b5f6-a899733e8157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:52.975719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:53.014465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ff710-cf14-4c2d-a35a-91323049a1fd None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:53.016166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0c9ff710-cf14-4c2d-a35a-91323049a1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:53.029287 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ff710-cf14-4c2d-a35a-91323049a1fd None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:53.033746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f292400-11da-4310-be4d-9f9e24a8e72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:53.034397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292400-11da-4310-be4d-9f9e24a8e72e service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:53.034678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292400-11da-4310-be4d-9f9e24a8e72e service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:53.034951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f292400-11da-4310-be4d-9f9e24a8e72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:53.043491 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f292400-11da-4310-be4d-9f9e24a8e72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:53.044892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f292400-11da-4310-be4d-9f9e24a8e72e service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:53.053861 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 737/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:55.548964 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a2117-b06e-4af6-8d7f-56053db71ea0 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:55.549502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a2117-b06e-4af6-8d7f-56053db71ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:55.549502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a2117-b06e-4af6-8d7f-56053db71ea0 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:55.551326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:49:55.556580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed200-a32a-47e2-a545-0fa3300bf936 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:55.557019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed200-a32a-47e2-a545-0fa3300bf936 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:55.557130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aed200-a32a-47e2-a545-0fa3300bf936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:55.575855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e0aed200-a32a-47e2-a545-0fa3300bf936 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:55.577056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e0aed200-a32a-47e2-a545-0fa3300bf936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:55.585431 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:55.623598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a2117-b06e-4af6-8d7f-56053db71ea0 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:55.634457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a2117-b06e-4af6-8d7f-56053db71ea0 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:55.637917 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e4c3e-fbee-48ed-a49a-fa7bb5283ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:55.638561 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e4c3e-fbee-48ed-a49a-fa7bb5283ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:55.638836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e4c3e-fbee-48ed-a49a-fa7bb5283ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:55.639103 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e4c3e-fbee-48ed-a49a-fa7bb5283ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:55.648677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e4c3e-fbee-48ed-a49a-fa7bb5283ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:55.650123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e4c3e-fbee-48ed-a49a-fa7bb5283ea3 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:55.660915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 717/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:49:57.993740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99cd0-5395-4e7b-bc3c-9d81f80f2ff8 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:57.994337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99cd0-5395-4e7b-bc3c-9d81f80f2ff8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:57.994337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e99cd0-5395-4e7b-bc3c-9d81f80f2ff8 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:57.996079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:49:58.002342 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43527a7-9246-46a2-a344-af13e950f157 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:58.002768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43527a7-9246-46a2-a344-af13e950f157 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:58.002885 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43527a7-9246-46a2-a344-af13e950f157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:58.020214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a43527a7-9246-46a2-a344-af13e950f157 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:49:58.021485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a43527a7-9246-46a2-a344-af13e950f157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:49:58.029296 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:49:58.067160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e99cd0-5395-4e7b-bc3c-9d81f80f2ff8 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:49:58.077588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e99cd0-5395-4e7b-bc3c-9d81f80f2ff8 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:49:58.081110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eadef9-0df5-4a5c-a79b-b50c6f0e2714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:49:58.081747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eadef9-0df5-4a5c-a79b-b50c6f0e2714 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:49:58.082055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eadef9-0df5-4a5c-a79b-b50c6f0e2714 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:49:58.082333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eadef9-0df5-4a5c-a79b-b50c6f0e2714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:49:58.090959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eadef9-0df5-4a5c-a79b-b50c6f0e2714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:49:58.092377 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eadef9-0df5-4a5c-a79b-b50c6f0e2714 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:49:58.101501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 740/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:00.485563 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26423a89-f3da-4e43-9bb7-7488c73f0351 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:00.486122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26423a89-f3da-4e43-9bb7-7488c73f0351 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:00.486122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26423a89-f3da-4e43-9bb7-7488c73f0351 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:00.487917 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:00.493109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9062-54d5-4c4f-92a8-d1f86a453003 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:00.493560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9062-54d5-4c4f-92a8-d1f86a453003 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:00.493654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9062-54d5-4c4f-92a8-d1f86a453003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:00.511503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-073f9062-54d5-4c4f-92a8-d1f86a453003 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:00.512684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-073f9062-54d5-4c4f-92a8-d1f86a453003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:00.521036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:00.561741 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26423a89-f3da-4e43-9bb7-7488c73f0351 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:00.569622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26423a89-f3da-4e43-9bb7-7488c73f0351 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:00.573145 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294dce2-9d02-486c-855c-af5d3b1db297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:00.573771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294dce2-9d02-486c-855c-af5d3b1db297 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:00.574080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294dce2-9d02-486c-855c-af5d3b1db297 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:00.574355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294dce2-9d02-486c-855c-af5d3b1db297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:00.583542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294dce2-9d02-486c-855c-af5d3b1db297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:00.584963 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294dce2-9d02-486c-855c-af5d3b1db297 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:00.594181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 720/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:02.930126 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225aadb9-a1fe-4a2c-96dc-5ad3a2bd408f None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:02.930675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225aadb9-a1fe-4a2c-96dc-5ad3a2bd408f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:02.930675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225aadb9-a1fe-4a2c-96dc-5ad3a2bd408f None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:02.932429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:02.937677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9df948-0cf7-44d2-98a6-a3b6d76e8952 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:02.938131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9df948-0cf7-44d2-98a6-a3b6d76e8952 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:02.938381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9df948-0cf7-44d2-98a6-a3b6d76e8952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:02.955863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ee9df948-0cf7-44d2-98a6-a3b6d76e8952 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:02.957063 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ee9df948-0cf7-44d2-98a6-a3b6d76e8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:02.964612 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:03.003198 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225aadb9-a1fe-4a2c-96dc-5ad3a2bd408f None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:03.013536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225aadb9-a1fe-4a2c-96dc-5ad3a2bd408f None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:03.017507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a6471-8adb-4229-8e4d-413f3c5a5cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:03.018166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a6471-8adb-4229-8e4d-413f3c5a5cbd service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:03.018452 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a6471-8adb-4229-8e4d-413f3c5a5cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:03.018726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a6471-8adb-4229-8e4d-413f3c5a5cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:03.027510 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a6471-8adb-4229-8e4d-413f3c5a5cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:03.028968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a6471-8adb-4229-8e4d-413f3c5a5cbd service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:03.039212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 743/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:05.367743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941be6-bc32-4a5e-ae6f-8b993e34c2fd None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:05.368330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941be6-bc32-4a5e-ae6f-8b993e34c2fd None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:05.368330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941be6-bc32-4a5e-ae6f-8b993e34c2fd None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:05.369979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:05.375328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bb2dd-54c5-4b69-b031-a9d0d6abc85e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:05.376255 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bb2dd-54c5-4b69-b031-a9d0d6abc85e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:05.376404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bb2dd-54c5-4b69-b031-a9d0d6abc85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:05.394357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b79bb2dd-54c5-4b69-b031-a9d0d6abc85e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:05.395540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b79bb2dd-54c5-4b69-b031-a9d0d6abc85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:05.403231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:05.441553 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941be6-bc32-4a5e-ae6f-8b993e34c2fd None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:05.452009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941be6-bc32-4a5e-ae6f-8b993e34c2fd None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:05.456270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290c5d4-d874-4c4f-b958-71d281afec72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:05.456896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c5d4-d874-4c4f-b958-71d281afec72 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:05.457170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c5d4-d874-4c4f-b958-71d281afec72 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:05.457436 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290c5d4-d874-4c4f-b958-71d281afec72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:05.466083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290c5d4-d874-4c4f-b958-71d281afec72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:05.467484 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290c5d4-d874-4c4f-b958-71d281afec72 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:05.476511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 723/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:07.787453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974c9cd-3425-46f5-9cc5-24b59c6acfe3 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:07.788019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974c9cd-3425-46f5-9cc5-24b59c6acfe3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:07.788019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974c9cd-3425-46f5-9cc5-24b59c6acfe3 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:07.789757 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:07.795023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3abce-f2cc-4770-9c21-7cab42b7e849 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:07.795478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3abce-f2cc-4770-9c21-7cab42b7e849 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:07.795609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3abce-f2cc-4770-9c21-7cab42b7e849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:07.813000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-cfd3abce-f2cc-4770-9c21-7cab42b7e849 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:07.814271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-cfd3abce-f2cc-4770-9c21-7cab42b7e849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:07.822024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:50:07.861011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974c9cd-3425-46f5-9cc5-24b59c6acfe3 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:07.871480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974c9cd-3425-46f5-9cc5-24b59c6acfe3 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:07.874955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abce40b-1bcc-42ab-a8c0-34de980fd3e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:07.876647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abce40b-1bcc-42ab-a8c0-34de980fd3e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:07.876647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abce40b-1bcc-42ab-a8c0-34de980fd3e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:07.876647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abce40b-1bcc-42ab-a8c0-34de980fd3e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:07.885324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abce40b-1bcc-42ab-a8c0-34de980fd3e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:07.886771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abce40b-1bcc-42ab-a8c0-34de980fd3e0 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:07.896804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 746/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:10.219007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c74ec8-711a-4bb8-a581-1bf52a41df13 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:10.220364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c74ec8-711a-4bb8-a581-1bf52a41df13 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:10.220364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c74ec8-711a-4bb8-a581-1bf52a41df13 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:10.222011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 725/1471] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:10.227392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d5a3c-56e4-4e3d-b0ca-c48501f840bb None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:10.227804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d5a3c-56e4-4e3d-b0ca-c48501f840bb None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:10.227957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d5a3c-56e4-4e3d-b0ca-c48501f840bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:10.245688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d97d5a3c-56e4-4e3d-b0ca-c48501f840bb None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:10.246944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d97d5a3c-56e4-4e3d-b0ca-c48501f840bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:10.254893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 747/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:10.291571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c74ec8-711a-4bb8-a581-1bf52a41df13 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:10.302463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c74ec8-711a-4bb8-a581-1bf52a41df13 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:10.309164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec3f63-4b94-41ae-b321-c86dfaa106c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:10.309947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec3f63-4b94-41ae-b321-c86dfaa106c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:10.310258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec3f63-4b94-41ae-b321-c86dfaa106c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:10.310530 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec3f63-4b94-41ae-b321-c86dfaa106c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:10.319852 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec3f63-4b94-41ae-b321-c86dfaa106c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:10.321339 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec3f63-4b94-41ae-b321-c86dfaa106c0 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:10.331012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 726/1473] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:30.997072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679456ea-5a5b-436a-b22b-50a1932f72a5 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:30.997711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679456ea-5a5b-436a-b22b-50a1932f72a5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:30.997711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679456ea-5a5b-436a-b22b-50a1932f72a5 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:30.999404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 748/1474] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:31.004949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84f444-72b1-42fa-9b51-889d5a803d15 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:31.005406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84f444-72b1-42fa-9b51-889d5a803d15 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:31.005594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84f444-72b1-42fa-9b51-889d5a803d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:31.024276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6a84f444-72b1-42fa-9b51-889d5a803d15 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:31.025494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6a84f444-72b1-42fa-9b51-889d5a803d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:31.033924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 727/1475] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:31.080784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a16b-c19b-4ffb-b478-a77aae39cba7 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:31.081060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a16b-c19b-4ffb-b478-a77aae39cba7 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:31.081327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a16b-c19b-4ffb-b478-a77aae39cba7 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:31.083106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 749/1476] 10.222.0.26 () {54 vars in 962 bytes} [Mon Feb 28 21:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:31.087905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d4c0f-5ec0-49a7-9cc0-5a0471f061c3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:31.088188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d4c0f-5ec0-49a7-9cc0-5a0471f061c3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:31.088458 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d4c0f-5ec0-49a7-9cc0-5a0471f061c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:31.106989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-0f8d4c0f-5ec0-49a7-9cc0-5a0471f061c3 None None] MFA Rules not processed for user `500eaf6aadff441ca1e535443e1d8c03`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:31.108191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0f8d4c0f-5ec0-49a7-9cc0-5a0471f061c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:31.114646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 728/1477] 10.222.0.26 () {58 vars in 1059 bytes} [Mon Feb 28 21:50:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:31.121836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a16b-c19b-4ffb-b478-a77aae39cba7 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:31.132591 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a16b-c19b-4ffb-b478-a77aae39cba7 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:31.136189 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a967-8f5d-4f9b-a4d9-7ac15a3ea08f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500eaf6aadff441ca1e535443e1d8c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:31.136813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a967-8f5d-4f9b-a4d9-7ac15a3ea08f service glance] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:31.137101 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a967-8f5d-4f9b-a4d9-7ac15a3ea08f service glance] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:31.137514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a967-8f5d-4f9b-a4d9-7ac15a3ea08f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:31.146870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2a967-8f5d-4f9b-a4d9-7ac15a3ea08f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:31.148325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2a967-8f5d-4f9b-a4d9-7ac15a3ea08f service glance] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:31.158006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 750/1478] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:33.612541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30c166-672e-4120-86da-5e492e9d83ce None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:33.613134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30c166-672e-4120-86da-5e492e9d83ce None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:33.613134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30c166-672e-4120-86da-5e492e9d83ce None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:33.614891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 729/1479] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:50:33.620070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d045ff4-8588-46b1-889e-41cdc962566f None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:33.620476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d045ff4-8588-46b1-889e-41cdc962566f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:33.620629 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d045ff4-8588-46b1-889e-41cdc962566f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:33.638832 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2d045ff4-8588-46b1-889e-41cdc962566f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:33.641178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2d045ff4-8588-46b1-889e-41cdc962566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:33.649231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 751/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:33.673384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30c166-672e-4120-86da-5e492e9d83ce None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:33.685448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30c166-672e-4120-86da-5e492e9d83ce None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:33.690374 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58024ef2-63eb-484b-aec4-aaec56f9219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:33.691006 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58024ef2-63eb-484b-aec4-aaec56f9219e admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:33.691281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58024ef2-63eb-484b-aec4-aaec56f9219e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:33.691549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58024ef2-63eb-484b-aec4-aaec56f9219e admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:33.692259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58024ef2-63eb-484b-aec4-aaec56f9219e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:33.693943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING py.warnings [None req-58024ef2-63eb-484b-aec4-aaec56f9219e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:50:33.693943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: warnings.warn(msg) Feb 28 21:50:33.693943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: Feb 28 21:50:33.695094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58024ef2-63eb-484b-aec4-aaec56f9219e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:33.714957 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 730/1481] 10.222.0.26 () {56 vars in 1108 bytes} [Mon Feb 28 21:50:33 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:50:36.028312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b401-0b59-4b16-942f-eb58da7416a0 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:36.028908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b401-0b59-4b16-942f-eb58da7416a0 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:36.028908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653b401-0b59-4b16-942f-eb58da7416a0 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:36.031238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 752/1482] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:36.036516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a04ab-45c7-41e5-8df4-ec1ae070eeae None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:36.036927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a04ab-45c7-41e5-8df4-ec1ae070eeae None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:36.037058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a04ab-45c7-41e5-8df4-ec1ae070eeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:36.055083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ae2a04ab-45c7-41e5-8df4-ec1ae070eeae None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:36.056254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ae2a04ab-45c7-41e5-8df4-ec1ae070eeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:36.064117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 731/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:36.104664 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b401-0b59-4b16-942f-eb58da7416a0 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:36.119558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653b401-0b59-4b16-942f-eb58da7416a0 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:36.125137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2def166-a785-40ec-992d-bc96897783ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:36.125777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def166-a785-40ec-992d-bc96897783ed service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:36.126086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def166-a785-40ec-992d-bc96897783ed service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:36.126377 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def166-a785-40ec-992d-bc96897783ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:36.134644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2def166-a785-40ec-992d-bc96897783ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:36.140681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2def166-a785-40ec-992d-bc96897783ed service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:36.145506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 753/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:38.594432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4855c-cb42-45ae-8f93-622b1fa3f00e None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:38.594978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4855c-cb42-45ae-8f93-622b1fa3f00e None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:38.594978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4855c-cb42-45ae-8f93-622b1fa3f00e None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:38.596758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 732/1485] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:38.602069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e3aaf-6269-432a-ac93-0eac7dede54b None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:38.602531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e3aaf-6269-432a-ac93-0eac7dede54b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:38.602628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e3aaf-6269-432a-ac93-0eac7dede54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:38.621493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-562e3aaf-6269-432a-ac93-0eac7dede54b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:38.622802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-562e3aaf-6269-432a-ac93-0eac7dede54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:38.632006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 754/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:38.667571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4855c-cb42-45ae-8f93-622b1fa3f00e None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:38.678817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4855c-cb42-45ae-8f93-622b1fa3f00e None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:38.682429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816fd06-d31e-4660-aad2-b28b506ba0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:38.683050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816fd06-d31e-4660-aad2-b28b506ba0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:38.683326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816fd06-d31e-4660-aad2-b28b506ba0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:38.683591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816fd06-d31e-4660-aad2-b28b506ba0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:38.693251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816fd06-d31e-4660-aad2-b28b506ba0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:38.694746 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816fd06-d31e-4660-aad2-b28b506ba0c9 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:38.704925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 733/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:41.036580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be97b-a38b-4099-a83f-0750e99e2169 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:41.037135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be97b-a38b-4099-a83f-0750e99e2169 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:41.037135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71be97b-a38b-4099-a83f-0750e99e2169 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:41.038949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 755/1488] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:41.044108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dda731-7ea8-43e0-beda-c9741f333acf None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:41.044563 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dda731-7ea8-43e0-beda-c9741f333acf None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:41.044666 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dda731-7ea8-43e0-beda-c9741f333acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:41.063421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-72dda731-7ea8-43e0-beda-c9741f333acf None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:41.064536 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-72dda731-7ea8-43e0-beda-c9741f333acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:41.072326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 734/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:41.111908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71be97b-a38b-4099-a83f-0750e99e2169 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:41.122360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71be97b-a38b-4099-a83f-0750e99e2169 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:41.126495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9deab3-a97e-4162-98d8-ad7534c723db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:41.127128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9deab3-a97e-4162-98d8-ad7534c723db service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:41.127410 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9deab3-a97e-4162-98d8-ad7534c723db service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:41.127688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9deab3-a97e-4162-98d8-ad7534c723db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:41.136618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9deab3-a97e-4162-98d8-ad7534c723db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:41.138132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9deab3-a97e-4162-98d8-ad7534c723db service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:41.147454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 756/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:43.522918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea08b78-efba-42e1-886d-2df9173a305a None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:43.523578 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea08b78-efba-42e1-886d-2df9173a305a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:43.523578 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea08b78-efba-42e1-886d-2df9173a305a None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:43.525229 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 735/1491] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:43.531562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b3fa-619c-4725-8349-a449c758a4db None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:43.532016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b3fa-619c-4725-8349-a449c758a4db None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:43.532149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b3fa-619c-4725-8349-a449c758a4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:43.551483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-6633b3fa-619c-4725-8349-a449c758a4db None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:43.552728 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-6633b3fa-619c-4725-8349-a449c758a4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:43.560561 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 757/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:43.600861 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea08b78-efba-42e1-886d-2df9173a305a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:43.612169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea08b78-efba-42e1-886d-2df9173a305a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:43.615604 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961571b0-e5f3-43cc-baaa-5623b22e30f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:43.616223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961571b0-e5f3-43cc-baaa-5623b22e30f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:43.616505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961571b0-e5f3-43cc-baaa-5623b22e30f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:43.616775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961571b0-e5f3-43cc-baaa-5623b22e30f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:43.625723 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961571b0-e5f3-43cc-baaa-5623b22e30f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:43.627180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961571b0-e5f3-43cc-baaa-5623b22e30f2 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:43.636166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 736/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:50:46.322114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698df73-53d3-4030-8dca-81e4e662d5c0 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:46.322660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698df73-53d3-4030-8dca-81e4e662d5c0 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:46.322660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698df73-53d3-4030-8dca-81e4e662d5c0 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:46.324436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 758/1494] 10.222.0.26 () {54 vars in 926 bytes} [Mon Feb 28 21:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:50:46.330311 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36cebf-c91a-4fd6-927b-8828b6172356 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:46.330747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36cebf-c91a-4fd6-927b-8828b6172356 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:46.330848 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36cebf-c91a-4fd6-927b-8828b6172356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:46.348031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-cc36cebf-c91a-4fd6-927b-8828b6172356 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:50:46.349201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-cc36cebf-c91a-4fd6-927b-8828b6172356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:50:46.357027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 737/1495] 10.222.0.26 () {58 vars in 1023 bytes} [Mon Feb 28 21:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:50:46.396256 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698df73-53d3-4030-8dca-81e4e662d5c0 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:50:46.407174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698df73-53d3-4030-8dca-81e4e662d5c0 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:50:46.410662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a605d-0db7-47a6-a3d0-2f416bba4a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:50:46.411280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a605d-0db7-47a6-a3d0-2f416bba4a70 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:50:46.411555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a605d-0db7-47a6-a3d0-2f416bba4a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:50:46.411821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a605d-0db7-47a6-a3d0-2f416bba4a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:50:46.420332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a605d-0db7-47a6-a3d0-2f416bba4a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:50:46.422556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a605d-0db7-47a6-a3d0-2f416bba4a70 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:50:46.431581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 759/1496] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:52:29.576787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a148d2-77d9-4965-8aa7-9ffb61bd929e None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:29.577434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a148d2-77d9-4965-8aa7-9ffb61bd929e None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:29.577434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a148d2-77d9-4965-8aa7-9ffb61bd929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:29.595370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-71a148d2-77d9-4965-8aa7-9ffb61bd929e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:52:29.596540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-71a148d2-77d9-4965-8aa7-9ffb61bd929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:52:29.604555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 738/1497] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:52:29.613703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bd93f-3b79-453b-8070-b19eb1fef934 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:29.614245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bd93f-3b79-453b-8070-b19eb1fef934 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:29.614359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bd93f-3b79-453b-8070-b19eb1fef934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:29.631595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-fb1bd93f-3b79-453b-8070-b19eb1fef934 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:52:29.632772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fb1bd93f-3b79-453b-8070-b19eb1fef934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:52:29.641131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 760/1498] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:52:29.645618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a148d2-77d9-4965-8aa7-9ffb61bd929e None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:52:29.655792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a148d2-77d9-4965-8aa7-9ffb61bd929e None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:52:29.660496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cff57e-05e2-4757-b790-b67f33427c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:52:29.661146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cff57e-05e2-4757-b790-b67f33427c6f admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:29.661425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cff57e-05e2-4757-b790-b67f33427c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:29.661698 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cff57e-05e2-4757-b790-b67f33427c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:29.662453 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cff57e-05e2-4757-b790-b67f33427c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:52:29.662758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cff57e-05e2-4757-b790-b67f33427c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:52:29.663785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING py.warnings [None req-11cff57e-05e2-4757-b790-b67f33427c6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:52:29.663785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: warnings.warn(msg) Feb 28 21:52:29.663785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: Feb 28 21:52:29.664662 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cff57e-05e2-4757-b790-b67f33427c6f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:52:29.676031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 739/1499] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:52:29.683925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bd93f-3b79-453b-8070-b19eb1fef934 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:52:29.693167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bd93f-3b79-453b-8070-b19eb1fef934 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:52:29.697761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9821a-9494-4827-961a-e77301c97a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:52:29.698440 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9821a-9494-4827-961a-e77301c97a55 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:29.698723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9821a-9494-4827-961a-e77301c97a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:29.699000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9821a-9494-4827-961a-e77301c97a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:29.700199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9821a-9494-4827-961a-e77301c97a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:52:29.701208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING py.warnings [None req-a9f9821a-9494-4827-961a-e77301c97a55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:52:29.701208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: warnings.warn(msg) Feb 28 21:52:29.701208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: Feb 28 21:52:29.702432 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9821a-9494-4827-961a-e77301c97a55 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:52:29.826445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 761/1500] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:52:29 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:52:29.830718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cff57e-05e2-4757-b790-b67f33427c6f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:52:29.840505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cff57e-05e2-4757-b790-b67f33427c6f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:52:29.896049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bc471-1ed4-4bbb-b57d-2bbf3d8c333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:52:29.896744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bc471-1ed4-4bbb-b57d-2bbf3d8c333e admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:29.897018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bc471-1ed4-4bbb-b57d-2bbf3d8c333e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:29.897285 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bc471-1ed4-4bbb-b57d-2bbf3d8c333e admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:29.897951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bc471-1ed4-4bbb-b57d-2bbf3d8c333e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:52:29.902217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING py.warnings [None req-d67bc471-1ed4-4bbb-b57d-2bbf3d8c333e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:52:29.902217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: warnings.warn(msg) Feb 28 21:52:29.902217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: Feb 28 21:52:29.902217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bc471-1ed4-4bbb-b57d-2bbf3d8c333e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:52:29.990904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 740/1501] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:52:29 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:52:29.994823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9821a-9494-4827-961a-e77301c97a55 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:52:30.005657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9821a-9494-4827-961a-e77301c97a55 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:52:30.010253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f896a0-0810-4f24-b21d-0c0de1ff45a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:52:30.010921 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f896a0-0810-4f24-b21d-0c0de1ff45a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:30.011185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f896a0-0810-4f24-b21d-0c0de1ff45a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:30.011456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f896a0-0810-4f24-b21d-0c0de1ff45a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:30.013046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f896a0-0810-4f24-b21d-0c0de1ff45a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:52:30.014077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING py.warnings [None req-d6f896a0-0810-4f24-b21d-0c0de1ff45a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:52:30.014077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: warnings.warn(msg) Feb 28 21:52:30.014077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: Feb 28 21:52:30.014959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f896a0-0810-4f24-b21d-0c0de1ff45a4 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:52:30.027343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 762/1502] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:52:30.031509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bc471-1ed4-4bbb-b57d-2bbf3d8c333e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:52:30.041183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bc471-1ed4-4bbb-b57d-2bbf3d8c333e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:52:30.045742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf7e96-7ea9-4663-834b-9c47f486eb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:52:30.046444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7e96-7ea9-4663-834b-9c47f486eb9d admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:30.046708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7e96-7ea9-4663-834b-9c47f486eb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:30.046980 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf7e96-7ea9-4663-834b-9c47f486eb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:30.047696 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf7e96-7ea9-4663-834b-9c47f486eb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:52:30.048695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING py.warnings [None req-a1bf7e96-7ea9-4663-834b-9c47f486eb9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:52:30.048695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: warnings.warn(msg) Feb 28 21:52:30.048695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: Feb 28 21:52:30.049565 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf7e96-7ea9-4663-834b-9c47f486eb9d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:52:30.063150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 741/1503] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:52:30.067313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f896a0-0810-4f24-b21d-0c0de1ff45a4 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:52:30.077880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f896a0-0810-4f24-b21d-0c0de1ff45a4 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:52:30.082400 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072ff10-a12d-4445-b618-b855e23b0ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:52:30.083212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072ff10-a12d-4445-b618-b855e23b0ada admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:30.083484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072ff10-a12d-4445-b618-b855e23b0ada admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:30.083751 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072ff10-a12d-4445-b618-b855e23b0ada admin admin] PATH_INFO: `/v3/projects/645d9753eb9e415daeb8e8bbb2f9a38f/users/d42ec5e6cf0840a2910ad2f3af038fd7/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:30.097666 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072ff10-a12d-4445-b618-b855e23b0ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=645d9753eb9e415daeb8e8bbb2f9a38f, user_id=d42ec5e6cf0840a2910ad2f3af038fd7, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:52:30.098974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING py.warnings [None req-0072ff10-a12d-4445-b618-b855e23b0ada admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:52:30.098974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: warnings.warn(msg) Feb 28 21:52:30.098974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: Feb 28 21:52:30.100895 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072ff10-a12d-4445-b618-b855e23b0ada admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:52:30.190965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 763/1504] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:52:30 2022] PUT /identity/v3/projects/645d9753eb9e415daeb8e8bbb2f9a38f/users/d42ec5e6cf0840a2910ad2f3af038fd7/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:52:30.202204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921957e-110c-4ad3-bb48-2f5a8c9b3165 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:30.206558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921957e-110c-4ad3-bb48-2f5a8c9b3165 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:30.206558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921957e-110c-4ad3-bb48-2f5a8c9b3165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:30.228416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9921957e-110c-4ad3-bb48-2f5a8c9b3165 None None] MFA Rules not processed for user `d42ec5e6cf0840a2910ad2f3af038fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:52:30.229638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9921957e-110c-4ad3-bb48-2f5a8c9b3165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:52:30.291307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 742/1505] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:52:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:52:30.302764 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072ff10-a12d-4445-b618-b855e23b0ada admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:52:30.371095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072ff10-a12d-4445-b618-b855e23b0ada admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:52:30.377095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20544-8509-40f9-9a8b-ac92e53d8dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:52:30.377726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20544-8509-40f9-9a8b-ac92e53d8dff service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:30.378013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20544-8509-40f9-9a8b-ac92e53d8dff service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:30.378333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20544-8509-40f9-9a8b-ac92e53d8dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:30.385639 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f20544-8509-40f9-9a8b-ac92e53d8dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:52:30.387288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f20544-8509-40f9-9a8b-ac92e53d8dff service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:52:30.396066 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 764/1506] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:52:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:52:30.464454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f4a06-ee14-4911-a7d2-e285404b362a None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:30.464738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f4a06-ee14-4911-a7d2-e285404b362a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:30.465010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f4a06-ee14-4911-a7d2-e285404b362a None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:30.467048 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 743/1507] 10.222.0.26 () {52 vars in 829 bytes} [Mon Feb 28 21:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:52:30.470511 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20544-8509-40f9-9a8b-ac92e53d8dff service nova] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:52:30.530858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20544-8509-40f9-9a8b-ac92e53d8dff service nova] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:52:30.535416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:52:30.536273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:30.536557 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:30.536830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] PATH_INFO: `/v3/users/d42ec5e6cf0840a2910ad2f3af038fd7` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:30.538029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42ec5e6cf0840a2910ad2f3af038fd7)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:52:30.539039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING py.warnings [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:52:30.539039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: warnings.warn(msg) Feb 28 21:52:30.539039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: Feb 28 21:52:30.540253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:52:30.710606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42ec5e6cf0840a2910ad2f3af038fd7'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:52:30.724304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42ec5e6cf0840a2910ad2f3af038fd7'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:52:30.812868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42ec5e6cf0840a2910ad2f3af038fd7'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:52:30.830910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42ec5e6cf0840a2910ad2f3af038fd7'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:52:30.832220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42ec5e6cf0840a2910ad2f3af038fd7'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:52:30.837704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 765/1508] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:52:30 2022] DELETE /identity/v3/users/d42ec5e6cf0840a2910ad2f3af038fd7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:52:30.842662 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb0b7-e409-4d00-bbb6-5bd69e7a6aa8 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:30.843127 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb0b7-e409-4d00-bbb6-5bd69e7a6aa8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:30.843218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afb0b7-e409-4d00-bbb6-5bd69e7a6aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:30.861548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-b2afb0b7-e409-4d00-bbb6-5bd69e7a6aa8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:52:30.862767 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b2afb0b7-e409-4d00-bbb6-5bd69e7a6aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:52:30.919450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 744/1509] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:52:30.929046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:52:30.930483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:52:30.987128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39382033-6d8e-46cf-b08c-8723bdcb7c5f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:52:30.990573 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727660e-a8c3-4d6d-ac1c-d654a4de7e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:52:30.991209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727660e-a8c3-4d6d-ac1c-d654a4de7e5d service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:30.991494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727660e-a8c3-4d6d-ac1c-d654a4de7e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:30.991763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727660e-a8c3-4d6d-ac1c-d654a4de7e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:31.000574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727660e-a8c3-4d6d-ac1c-d654a4de7e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:52:31.002020 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727660e-a8c3-4d6d-ac1c-d654a4de7e5d service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:52:31.011072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 766/1510] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:52:31.539388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb0b7-e409-4d00-bbb6-5bd69e7a6aa8 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:52:31.539388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b2afb0b7-e409-4d00-bbb6-5bd69e7a6aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:52:31.549193 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afb0b7-e409-4d00-bbb6-5bd69e7a6aa8 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:52:31.555425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:52:31.556282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:52:31.556670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:52:31.556843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] PATH_INFO: `/v3/projects/645d9753eb9e415daeb8e8bbb2f9a38f` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:52:31.561463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=645d9753eb9e415daeb8e8bbb2f9a38f)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:52:31.562523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING py.warnings [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:52:31.562523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: warnings.warn(msg) Feb 28 21:52:31.562523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: Feb 28 21:52:31.563703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:52:31.692015 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645d9753eb9e415daeb8e8bbb2f9a38f', 'request_id': 'req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:52:31.704999 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645d9753eb9e415daeb8e8bbb2f9a38f', 'request_id': 'req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:52:31.711336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645d9753eb9e415daeb8e8bbb2f9a38f', 'request_id': 'req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:52:31.783983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] The token cache is being invalidate because project 645d9753eb9e415daeb8e8bbb2f9a38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:52:31.784268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:52:31.784878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-864663b9-6f6f-4a31-9239-5f4d9cbe0f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:52:31.786641 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 745/1511] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:52:31 2022] DELETE /identity/v3/projects/645d9753eb9e415daeb8e8bbb2f9a38f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:54:02.503571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82ef3-8df3-4d80-9b41-35dde0da1d14 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:02.504174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82ef3-8df3-4d80-9b41-35dde0da1d14 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:02.504174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa82ef3-8df3-4d80-9b41-35dde0da1d14 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:02.505887 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 767/1512] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:54:02.510711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c39fe9-7569-4864-9a88-aebeb3eaf52a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:02.511138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c39fe9-7569-4864-9a88-aebeb3eaf52a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:02.511238 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c39fe9-7569-4864-9a88-aebeb3eaf52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:02.528907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f6c39fe9-7569-4864-9a88-aebeb3eaf52a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:02.530117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f6c39fe9-7569-4864-9a88-aebeb3eaf52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:02.585570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 746/1513] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:02.740016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa82ef3-8df3-4d80-9b41-35dde0da1d14 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:54:02.741742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-8aa82ef3-8df3-4d80-9b41-35dde0da1d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:02.813057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa82ef3-8df3-4d80-9b41-35dde0da1d14 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:54:02.818440 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ea3ba-c4d1-42c5-aa95-d517d7b8041a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:54:02.819082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea3ba-c4d1-42c5-aa95-d517d7b8041a service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:02.819365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea3ba-c4d1-42c5-aa95-d517d7b8041a service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:02.819639 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ea3ba-c4d1-42c5-aa95-d517d7b8041a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:02.827904 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ea3ba-c4d1-42c5-aa95-d517d7b8041a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:54:02.829472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ea3ba-c4d1-42c5-aa95-d517d7b8041a service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:54:02.839324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 768/1514] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:54:03.617013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a94b2-fcdc-4ca4-8426-a73eea0881aa None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:03.617588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a94b2-fcdc-4ca4-8426-a73eea0881aa None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:03.617588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a94b2-fcdc-4ca4-8426-a73eea0881aa None None] PATH_INFO: `/v3` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:03.618894 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 747/1515] 10.222.0.16 () {54 vars in 925 bytes} [Mon Feb 28 21:54:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:54:03.625040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f4de-ee0d-45e7-a33d-fe6848178552 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:03.625485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f4de-ee0d-45e7-a33d-fe6848178552 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:03.625611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8f4de-ee0d-45e7-a33d-fe6848178552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:03.643960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-40b8f4de-ee0d-45e7-a33d-fe6848178552 None None] MFA Rules not processed for user `1875af7b72b247c9a2b5e1f2b2fb1eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:03.645208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-40b8f4de-ee0d-45e7-a33d-fe6848178552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:03.707463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 769/1516] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Feb 28 21:54:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:04.119304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78ff3e-4be6-418c-8ee6-458101222d70 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:04.120171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78ff3e-4be6-418c-8ee6-458101222d70 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:04.120453 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78ff3e-4be6-418c-8ee6-458101222d70 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:04.122307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 748/1517] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:54:04.127195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874ee5b-51dc-4fb3-bc95-95eb4cfe6d1a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:04.127486 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874ee5b-51dc-4fb3-bc95-95eb4cfe6d1a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:04.127757 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874ee5b-51dc-4fb3-bc95-95eb4cfe6d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:04.145849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-a874ee5b-51dc-4fb3-bc95-95eb4cfe6d1a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:04.147048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a874ee5b-51dc-4fb3-bc95-95eb4cfe6d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:04.154790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 770/1518] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:04.306113 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78ff3e-4be6-418c-8ee6-458101222d70 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:54:04.320150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78ff3e-4be6-418c-8ee6-458101222d70 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:54:04.325568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c285996-7597-4b87-9d60-e42aa12fa2f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:54:04.326226 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c285996-7597-4b87-9d60-e42aa12fa2f1 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:04.326512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c285996-7597-4b87-9d60-e42aa12fa2f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:04.326790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c285996-7597-4b87-9d60-e42aa12fa2f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:04.334576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c285996-7597-4b87-9d60-e42aa12fa2f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:54:04.336146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c285996-7597-4b87-9d60-e42aa12fa2f1 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:54:04.345895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 749/1519] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:54:07.922015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016af1a-5ea9-4746-94e3-3d924d68650a None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:07.922565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016af1a-5ea9-4746-94e3-3d924d68650a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:07.922565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016af1a-5ea9-4746-94e3-3d924d68650a None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:07.924326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 771/1520] 10.222.0.26 () {54 vars in 960 bytes} [Mon Feb 28 21:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:54:07.929389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc2a6f-a56a-4fc3-99a0-338cbe28005b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:07.929818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc2a6f-a56a-4fc3-99a0-338cbe28005b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:07.929920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc2a6f-a56a-4fc3-99a0-338cbe28005b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:07.949020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-49dc2a6f-a56a-4fc3-99a0-338cbe28005b None None] MFA Rules not processed for user `1875af7b72b247c9a2b5e1f2b2fb1eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:07.952382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-49dc2a6f-a56a-4fc3-99a0-338cbe28005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:07.958648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 750/1521] 10.222.0.26 () {58 vars in 1057 bytes} [Mon Feb 28 21:54:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:07.965854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016af1a-5ea9-4746-94e3-3d924d68650a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:54:07.980146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016af1a-5ea9-4746-94e3-3d924d68650a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:54:07.985178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f921f-c213-4f97-9df6-811fbb826d98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1875af7b72b247c9a2b5e1f2b2fb1eaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:54:07.987693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f921f-c213-4f97-9df6-811fbb826d98 service placement] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:07.987693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f921f-c213-4f97-9df6-811fbb826d98 service placement] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:07.987693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f921f-c213-4f97-9df6-811fbb826d98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:07.995270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f921f-c213-4f97-9df6-811fbb826d98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:54:07.996935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f921f-c213-4f97-9df6-811fbb826d98 service placement] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:54:08.006144 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 772/1522] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:54:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:54:16.054201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c033b7-f865-4bd7-8963-4a2d5ac05d52 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:16.054817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c033b7-f865-4bd7-8963-4a2d5ac05d52 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:16.054817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c033b7-f865-4bd7-8963-4a2d5ac05d52 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:16.056590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 751/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:54:16.061646 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362cba8-4696-4ad7-b6c9-5a40135eaf2b None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:16.062107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362cba8-4696-4ad7-b6c9-5a40135eaf2b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:16.062237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362cba8-4696-4ad7-b6c9-5a40135eaf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:16.081175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-f362cba8-4696-4ad7-b6c9-5a40135eaf2b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:16.082380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f362cba8-4696-4ad7-b6c9-5a40135eaf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:16.091273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 773/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:16.244451 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c033b7-f865-4bd7-8963-4a2d5ac05d52 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:54:16.258594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c033b7-f865-4bd7-8963-4a2d5ac05d52 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:54:16.264615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1280a-1dd6-4313-bb29-fe960edc0b83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:54:16.265239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1280a-1dd6-4313-bb29-fe960edc0b83 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:16.265516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1280a-1dd6-4313-bb29-fe960edc0b83 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:16.265787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1280a-1dd6-4313-bb29-fe960edc0b83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:16.273630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1280a-1dd6-4313-bb29-fe960edc0b83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:54:16.275332 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1280a-1dd6-4313-bb29-fe960edc0b83 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:54:16.284572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 752/1525] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:54:17.552289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70d0e2-4ca7-4b27-b053-e3a50e7c7415 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:17.552839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70d0e2-4ca7-4b27-b053-e3a50e7c7415 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:17.552839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70d0e2-4ca7-4b27-b053-e3a50e7c7415 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:17.554675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 774/1526] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 28 21:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:54:17.560263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a3bf-eac8-4c72-a73f-5c75de305d6f None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:17.560694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a3bf-eac8-4c72-a73f-5c75de305d6f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:17.560796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025a3bf-eac8-4c72-a73f-5c75de305d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:17.580423 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-4025a3bf-eac8-4c72-a73f-5c75de305d6f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:17.581607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4025a3bf-eac8-4c72-a73f-5c75de305d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:17.589368 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 753/1527] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 28 21:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:17.742673 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70d0e2-4ca7-4b27-b053-e3a50e7c7415 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:54:17.757220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70d0e2-4ca7-4b27-b053-e3a50e7c7415 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:54:17.763254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d694b92-d290-4d48-9911-d69b37249f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:54:17.763883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694b92-d290-4d48-9911-d69b37249f8c service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:17.764165 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694b92-d290-4d48-9911-d69b37249f8c service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:17.764447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d694b92-d290-4d48-9911-d69b37249f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:17.772536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d694b92-d290-4d48-9911-d69b37249f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:54:17.774130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d694b92-d290-4d48-9911-d69b37249f8c service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:54:17.783303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 775/1528] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:54:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:54:21.787053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da3c9-4f1c-4134-b3a8-09b1fd5e12b9 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:21.787624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da3c9-4f1c-4134-b3a8-09b1fd5e12b9 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:21.787624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28da3c9-4f1c-4134-b3a8-09b1fd5e12b9 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:21.789408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 754/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:54:21.795175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ee0fb-2315-4d70-9e89-fa99401f30f3 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:21.795578 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ee0fb-2315-4d70-9e89-fa99401f30f3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:21.795724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ee0fb-2315-4d70-9e89-fa99401f30f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:21.813318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ab3ee0fb-2315-4d70-9e89-fa99401f30f3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:21.814531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ab3ee0fb-2315-4d70-9e89-fa99401f30f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:21.822988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 776/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:21.859942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28da3c9-4f1c-4134-b3a8-09b1fd5e12b9 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:54:21.861634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b28da3c9-4f1c-4134-b3a8-09b1fd5e12b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:21.916814 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28da3c9-4f1c-4134-b3a8-09b1fd5e12b9 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:54:21.920516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f75c1-c4bd-4870-9a9a-0b19989efd61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:54:21.921153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f75c1-c4bd-4870-9a9a-0b19989efd61 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:21.921464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f75c1-c4bd-4870-9a9a-0b19989efd61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:21.921741 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f75c1-c4bd-4870-9a9a-0b19989efd61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:21.930710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f75c1-c4bd-4870-9a9a-0b19989efd61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:54:21.932140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f75c1-c4bd-4870-9a9a-0b19989efd61 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:54:21.941270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 755/1531] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:54:24.226159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baec74-7144-47dc-a6b8-6ae0d937d20b None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:24.226712 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baec74-7144-47dc-a6b8-6ae0d937d20b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:24.226919 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baec74-7144-47dc-a6b8-6ae0d937d20b None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:24.229243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 777/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:54:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:54:24.234914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881880-fa0d-46a8-9c15-6fe8df657dc5 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:24.235348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881880-fa0d-46a8-9c15-6fe8df657dc5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:24.235495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92881880-fa0d-46a8-9c15-6fe8df657dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:24.254186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-92881880-fa0d-46a8-9c15-6fe8df657dc5 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:24.255365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-92881880-fa0d-46a8-9c15-6fe8df657dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:24.263377 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 756/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:24.298145 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baec74-7144-47dc-a6b8-6ae0d937d20b None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:54:24.309129 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baec74-7144-47dc-a6b8-6ae0d937d20b None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:54:24.312577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4d452-5130-4525-ac0c-f44e3f8bcbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:54:24.313197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d452-5130-4525-ac0c-f44e3f8bcbcc service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:24.313474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d452-5130-4525-ac0c-f44e3f8bcbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:24.313745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d452-5130-4525-ac0c-f44e3f8bcbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:24.322630 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4d452-5130-4525-ac0c-f44e3f8bcbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:54:24.324053 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4d452-5130-4525-ac0c-f44e3f8bcbcc service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:54:24.333312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 778/1534] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:54:28.098656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e6f17-ba0e-4a93-a5b9-9cd5ad1eb32c None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:28.099222 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e6f17-ba0e-4a93-a5b9-9cd5ad1eb32c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:28.099222 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e6f17-ba0e-4a93-a5b9-9cd5ad1eb32c None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:28.100982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 757/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:54:28.106958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72abc-8fc8-475d-9835-33771a6660d3 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:28.107383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72abc-8fc8-475d-9835-33771a6660d3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:28.107484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72abc-8fc8-475d-9835-33771a6660d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:28.125531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d3a72abc-8fc8-475d-9835-33771a6660d3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:28.126748 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d3a72abc-8fc8-475d-9835-33771a6660d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:28.134573 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 779/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:28.389943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e6f17-ba0e-4a93-a5b9-9cd5ad1eb32c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:54:28.391834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1e1e6f17-ba0e-4a93-a5b9-9cd5ad1eb32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:28.447486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e6f17-ba0e-4a93-a5b9-9cd5ad1eb32c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:54:28.451035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569fe4e-b71b-4d2c-a5e6-1046de2c7fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:54:28.451673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569fe4e-b71b-4d2c-a5e6-1046de2c7fbb service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:28.451955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569fe4e-b71b-4d2c-a5e6-1046de2c7fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:28.452236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569fe4e-b71b-4d2c-a5e6-1046de2c7fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:28.460948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569fe4e-b71b-4d2c-a5e6-1046de2c7fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:54:28.462936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569fe4e-b71b-4d2c-a5e6-1046de2c7fbb service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:54:28.472394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 758/1537] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:54:30.832366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f043d-a49d-4415-8938-34cdeaed7ec8 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:30.832903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f043d-a49d-4415-8938-34cdeaed7ec8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:30.832903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f043d-a49d-4415-8938-34cdeaed7ec8 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:30.834696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 780/1538] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 28 21:54:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:54:30.840807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291e730-a32c-42b9-8efe-17e0b7f6802e None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:30.841240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291e730-a32c-42b9-8efe-17e0b7f6802e None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:30.841387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291e730-a32c-42b9-8efe-17e0b7f6802e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:30.859552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1291e730-a32c-42b9-8efe-17e0b7f6802e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:30.860635 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1291e730-a32c-42b9-8efe-17e0b7f6802e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:30.868797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 759/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 28 21:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:31.122429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57830e9a-2e2b-4baa-8666-b6321d9f5bf8 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:31.122714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57830e9a-2e2b-4baa-8666-b6321d9f5bf8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:31.122990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57830e9a-2e2b-4baa-8666-b6321d9f5bf8 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:31.124731 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 781/1540] 10.222.0.26 () {54 vars in 963 bytes} [Mon Feb 28 21:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:54:31.129932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202dfc3-abbb-4bd6-bab0-7003cb450350 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:31.135622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202dfc3-abbb-4bd6-bab0-7003cb450350 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:31.135622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202dfc3-abbb-4bd6-bab0-7003cb450350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:31.148909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f202dfc3-abbb-4bd6-bab0-7003cb450350 None None] MFA Rules not processed for user `ee8e7d47becf4c03967848eda8c311be`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:54:31.150761 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f202dfc3-abbb-4bd6-bab0-7003cb450350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:54:31.157174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 760/1541] 10.222.0.26 () {58 vars in 1060 bytes} [Mon Feb 28 21:54:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:54:31.164525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57830e9a-2e2b-4baa-8666-b6321d9f5bf8 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:54:31.175347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57830e9a-2e2b-4baa-8666-b6321d9f5bf8 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:54:31.178905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3f1d7-30df-42b9-9003-784f1f1e8ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:54:31.179533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f1d7-30df-42b9-9003-784f1f1e8ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:54:31.179815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f1d7-30df-42b9-9003-784f1f1e8ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:54:31.180090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3f1d7-30df-42b9-9003-784f1f1e8ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:54:31.189918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3f1d7-30df-42b9-9003-784f1f1e8ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:54:31.193842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3f1d7-30df-42b9-9003-784f1f1e8ed7 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:54:31.201368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 782/1542] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:55:58.178067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fba11-e420-4754-8517-c6fa3933fd3b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.178675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fba11-e420-4754-8517-c6fa3933fd3b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.178675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fba11-e420-4754-8517-c6fa3933fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.203388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-081fba11-e420-4754-8517-c6fa3933fd3b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.204593 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-081fba11-e420-4754-8517-c6fa3933fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.216487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 761/1543] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:55:58.227070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a23a9-0741-4df9-a70a-32999433f9fa None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.227674 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a23a9-0741-4df9-a70a-32999433f9fa None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.227674 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a23a9-0741-4df9-a70a-32999433f9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.246033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e844b-03a5-4119-9d65-ca37720e696f None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.246464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e844b-03a5-4119-9d65-ca37720e696f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.246746 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e844b-03a5-4119-9d65-ca37720e696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.251886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ba4a23a9-0741-4df9-a70a-32999433f9fa None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.253240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ba4a23a9-0741-4df9-a70a-32999433f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.269370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 783/1544] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:58.271681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-4d1e844b-03a5-4119-9d65-ca37720e696f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.272895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4d1e844b-03a5-4119-9d65-ca37720e696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.282076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a23a9-0741-4df9-a70a-32999433f9fa None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:58.287221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 762/1545] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:55:58.296766 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a23a9-0741-4df9-a70a-32999433f9fa None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:58.303306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e38b38-d719-47e6-86f0-137ba91adfec None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.303586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e38b38-d719-47e6-86f0-137ba91adfec None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.304056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e38b38-d719-47e6-86f0-137ba91adfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.308678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedd05f-4c66-44eb-87f7-848bd5672556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:58.309353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd05f-4c66-44eb-87f7-848bd5672556 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.309632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd05f-4c66-44eb-87f7-848bd5672556 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.309903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedd05f-4c66-44eb-87f7-848bd5672556 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.310653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedd05f-4c66-44eb-87f7-848bd5672556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:55:58.310956 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedd05f-4c66-44eb-87f7-848bd5672556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:58.311962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING py.warnings [None req-2eedd05f-4c66-44eb-87f7-848bd5672556 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:55:58.311962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: warnings.warn(msg) Feb 28 21:55:58.311962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: Feb 28 21:55:58.312841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedd05f-4c66-44eb-87f7-848bd5672556 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:58.333151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 784/1546] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:55:58.334802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-b9e38b38-d719-47e6-86f0-137ba91adfec None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.336020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b9e38b38-d719-47e6-86f0-137ba91adfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.342111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28d3d2-a0a3-4aed-b3d6-7f03f7554392 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.342644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28d3d2-a0a3-4aed-b3d6-7f03f7554392 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.343086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28d3d2-a0a3-4aed-b3d6-7f03f7554392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.357773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 763/1547] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:55:58.359060 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e38b38-d719-47e6-86f0-137ba91adfec None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:58.378939 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2e28d3d2-a0a3-4aed-b3d6-7f03f7554392 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.380819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2e28d3d2-a0a3-4aed-b3d6-7f03f7554392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.383558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e38b38-d719-47e6-86f0-137ba91adfec None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:58.389424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 785/1548] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:58.391122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28d3d2-a0a3-4aed-b3d6-7f03f7554392 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:58.402692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28d3d2-a0a3-4aed-b3d6-7f03f7554392 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:58.404261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdb622-d14c-4ff8-9573-99003f785f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:58.404932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb622-d14c-4ff8-9573-99003f785f27 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.405220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb622-d14c-4ff8-9573-99003f785f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.405495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb622-d14c-4ff8-9573-99003f785f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.406247 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdb622-d14c-4ff8-9573-99003f785f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:58.407254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING py.warnings [None req-46fdb622-d14c-4ff8-9573-99003f785f27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:55:58.407254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: warnings.warn(msg) Feb 28 21:55:58.407254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: Feb 28 21:55:58.408454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fdb622-d14c-4ff8-9573-99003f785f27 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:58.410063 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83e2d6-d059-4609-bec4-e5e49c86b244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:58.411823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e2d6-d059-4609-bec4-e5e49c86b244 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.412426 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e2d6-d059-4609-bec4-e5e49c86b244 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.412918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e2d6-d059-4609-bec4-e5e49c86b244 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.413841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e2d6-d059-4609-bec4-e5e49c86b244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:55:58.414461 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e2d6-d059-4609-bec4-e5e49c86b244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:58.416263 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e2d6-d059-4609-bec4-e5e49c86b244 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:58.430636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 786/1549] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:55:58.433010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340088f-f199-4317-a0fb-a055b89553a7 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.433524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340088f-f199-4317-a0fb-a055b89553a7 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.434042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340088f-f199-4317-a0fb-a055b89553a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.453891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-1340088f-f199-4317-a0fb-a055b89553a7 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.455475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1340088f-f199-4317-a0fb-a055b89553a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.465773 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 787/1550] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:58.466862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340088f-f199-4317-a0fb-a055b89553a7 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:58.477743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340088f-f199-4317-a0fb-a055b89553a7 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:58.483499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b82eb0-bbe0-4b8a-9918-ca4b00157f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:58.484611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b82eb0-bbe0-4b8a-9918-ca4b00157f9a admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.485093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b82eb0-bbe0-4b8a-9918-ca4b00157f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.485559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b82eb0-bbe0-4b8a-9918-ca4b00157f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.486570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b82eb0-bbe0-4b8a-9918-ca4b00157f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:58.488652 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b82eb0-bbe0-4b8a-9918-ca4b00157f9a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:58.534569 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 764/1551] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:55:58.536450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdb622-d14c-4ff8-9573-99003f785f27 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:58.610733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 788/1552] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:55:58.612524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6c0c4-b851-4080-896a-b14808a53fb9 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.612997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6c0c4-b851-4080-896a-b14808a53fb9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.613459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6c0c4-b851-4080-896a-b14808a53fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.648399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdb622-d14c-4ff8-9573-99003f785f27 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:58.659093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-feb6c0c4-b851-4080-896a-b14808a53fb9 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.660501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-feb6c0c4-b851-4080-896a-b14808a53fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.746318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccf5ed-197d-4d19-b23d-fe14e04c3850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:58.746903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccf5ed-197d-4d19-b23d-fe14e04c3850 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.747191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccf5ed-197d-4d19-b23d-fe14e04c3850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.747475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccf5ed-197d-4d19-b23d-fe14e04c3850 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.748191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccf5ed-197d-4d19-b23d-fe14e04c3850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:55:58.748498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccf5ed-197d-4d19-b23d-fe14e04c3850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:58.750156 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccf5ed-197d-4d19-b23d-fe14e04c3850 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:58.753871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 789/1553] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:58.755446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6c0c4-b851-4080-896a-b14808a53fb9 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:58.762542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 765/1554] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:55:58.763364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccf5ed-197d-4d19-b23d-fe14e04c3850 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:58.768680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6c0c4-b851-4080-896a-b14808a53fb9 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:58.773414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccf5ed-197d-4d19-b23d-fe14e04c3850 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:58.774377 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38577068-6bd2-4f62-9a2f-feaeedf195cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:58.775032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38577068-6bd2-4f62-9a2f-feaeedf195cf admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.775310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38577068-6bd2-4f62-9a2f-feaeedf195cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.775577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38577068-6bd2-4f62-9a2f-feaeedf195cf admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.776284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38577068-6bd2-4f62-9a2f-feaeedf195cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:58.777293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING py.warnings [None req-38577068-6bd2-4f62-9a2f-feaeedf195cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:55:58.777293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: warnings.warn(msg) Feb 28 21:55:58.777293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: Feb 28 21:55:58.778192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4953ff-4acd-4409-8a79-7e3345b7e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:58.778539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38577068-6bd2-4f62-9a2f-feaeedf195cf admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:58.778836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4953ff-4acd-4409-8a79-7e3345b7e969 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.779117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4953ff-4acd-4409-8a79-7e3345b7e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.779392 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4953ff-4acd-4409-8a79-7e3345b7e969 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.780071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4953ff-4acd-4409-8a79-7e3345b7e969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:58.781955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4953ff-4acd-4409-8a79-7e3345b7e969 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:58.865392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 790/1555] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:55:58.866746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0b96-135b-481e-968b-cbcfe90b49fa None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.867030 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0b96-135b-481e-968b-cbcfe90b49fa None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.873857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0b96-135b-481e-968b-cbcfe90b49fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.882243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 766/1556] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:55:58.883528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e756-4cac-483c-ad37-701195f2d632 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.883816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e756-4cac-483c-ad37-701195f2d632 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.884094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e756-4cac-483c-ad37-701195f2d632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.887135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-a9fd0b96-135b-481e-968b-cbcfe90b49fa None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.888368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a9fd0b96-135b-481e-968b-cbcfe90b49fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.897516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 791/1557] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:58.899089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eedc4-509e-405b-a777-14bc33984c12 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.899373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eedc4-509e-405b-a777-14bc33984c12 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.899656 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eedc4-509e-405b-a777-14bc33984c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.903586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1810e756-4cac-483c-ad37-701195f2d632 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.904843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1810e756-4cac-483c-ad37-701195f2d632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.913589 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 767/1558] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:58.914957 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46ad68-5f4d-4ac5-b2aa-08f376a1df59 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.915240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46ad68-5f4d-4ac5-b2aa-08f376a1df59 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.915517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46ad68-5f4d-4ac5-b2aa-08f376a1df59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.921835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-de1eedc4-509e-405b-a777-14bc33984c12 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.923058 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-de1eedc4-509e-405b-a777-14bc33984c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.931149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 792/1559] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:58.932439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde0622-4451-491d-8f80-391c455e310c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.932725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde0622-4451-491d-8f80-391c455e310c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.932998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde0622-4451-491d-8f80-391c455e310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.936818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-3b46ad68-5f4d-4ac5-b2aa-08f376a1df59 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.938095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3b46ad68-5f4d-4ac5-b2aa-08f376a1df59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.946943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 768/1560] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:58.947545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46ad68-5f4d-4ac5-b2aa-08f376a1df59 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:58.957315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46ad68-5f4d-4ac5-b2aa-08f376a1df59 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:58.957465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-cfde0622-4451-491d-8f80-391c455e310c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:58.959547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-cfde0622-4451-491d-8f80-391c455e310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:58.962441 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370fb7c-8d4c-4804-b5c7-f73165f3f5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:58.963113 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370fb7c-8d4c-4804-b5c7-f73165f3f5ee admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.963388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370fb7c-8d4c-4804-b5c7-f73165f3f5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.963660 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370fb7c-8d4c-4804-b5c7-f73165f3f5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.964590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370fb7c-8d4c-4804-b5c7-f73165f3f5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:58.966505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370fb7c-8d4c-4804-b5c7-f73165f3f5ee admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:58.967885 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 793/1561] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:58.968641 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde0622-4451-491d-8f80-391c455e310c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:58.982553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde0622-4451-491d-8f80-391c455e310c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:58.987472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23153010-7a9b-4d8f-b3e6-e2f3a23e1fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:58.988133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23153010-7a9b-4d8f-b3e6-e2f3a23e1fde admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:58.988413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23153010-7a9b-4d8f-b3e6-e2f3a23e1fde admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:58.988686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23153010-7a9b-4d8f-b3e6-e2f3a23e1fde admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:58.989964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23153010-7a9b-4d8f-b3e6-e2f3a23e1fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:58.991607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23153010-7a9b-4d8f-b3e6-e2f3a23e1fde admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.006900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 794/1562] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:55:59.006900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23153010-7a9b-4d8f-b3e6-e2f3a23e1fde admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.013413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23153010-7a9b-4d8f-b3e6-e2f3a23e1fde admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.018025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d757e5-ae85-4a46-bd24-715976a0f5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.018686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d757e5-ae85-4a46-bd24-715976a0f5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.018966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d757e5-ae85-4a46-bd24-715976a0f5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.019240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d757e5-ae85-4a46-bd24-715976a0f5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.020064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d757e5-ae85-4a46-bd24-715976a0f5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.021892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d757e5-ae85-4a46-bd24-715976a0f5f6 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.032253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 795/1563] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:55:59.033539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cd4eb-8b84-445e-bc53-5421a9b6b8de None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.034010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cd4eb-8b84-445e-bc53-5421a9b6b8de None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.034296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cd4eb-8b84-445e-bc53-5421a9b6b8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.052209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-041cd4eb-8b84-445e-bc53-5421a9b6b8de None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:59.053521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-041cd4eb-8b84-445e-bc53-5421a9b6b8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:59.061376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 796/1564] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:59.063284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf92d2-d8d0-4574-bead-2df987b36c46 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.063284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf92d2-d8d0-4574-bead-2df987b36c46 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.063284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf92d2-d8d0-4574-bead-2df987b36c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.081021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-cebf92d2-d8d0-4574-bead-2df987b36c46 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:59.087367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-cebf92d2-d8d0-4574-bead-2df987b36c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:59.090368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 797/1565] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:59.091540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e648-a201-408f-ad01-01160c16fd70 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.091843 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e648-a201-408f-ad01-01160c16fd70 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.092152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e648-a201-408f-ad01-01160c16fd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.109947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-8792e648-a201-408f-ad01-01160c16fd70 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:59.112186 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-8792e648-a201-408f-ad01-01160c16fd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:59.117294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 769/1566] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:55:58 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:55:59.118598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6de0c-a195-4806-99d7-3fa4f193d2fb None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.118947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6de0c-a195-4806-99d7-3fa4f193d2fb None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.119163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6de0c-a195-4806-99d7-3fa4f193d2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.127084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 798/1567] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:59.127084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e648-a201-408f-ad01-01160c16fd70 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.137862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e648-a201-408f-ad01-01160c16fd70 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.139030 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1ba6de0c-a195-4806-99d7-3fa4f193d2fb None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:55:59.140237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1ba6de0c-a195-4806-99d7-3fa4f193d2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:55:59.194976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66cc76-ab44-4ab0-a051-f18bc9bc7a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.195638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66cc76-ab44-4ab0-a051-f18bc9bc7a5d admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.195917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66cc76-ab44-4ab0-a051-f18bc9bc7a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.196192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66cc76-ab44-4ab0-a051-f18bc9bc7a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.196902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66cc76-ab44-4ab0-a051-f18bc9bc7a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:55:59.197199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66cc76-ab44-4ab0-a051-f18bc9bc7a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.198893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66cc76-ab44-4ab0-a051-f18bc9bc7a5d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.200704 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 770/1568] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:55:59.201595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6de0c-a195-4806-99d7-3fa4f193d2fb None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.211631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6de0c-a195-4806-99d7-3fa4f193d2fb None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.212830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 799/1569] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:55:59.214009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66cc76-ab44-4ab0-a051-f18bc9bc7a5d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.219538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce809f-9174-456a-a0b1-c0bc97c7132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.219538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce809f-9174-456a-a0b1-c0bc97c7132e admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.219538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce809f-9174-456a-a0b1-c0bc97c7132e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.219538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce809f-9174-456a-a0b1-c0bc97c7132e admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.220141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce809f-9174-456a-a0b1-c0bc97c7132e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.220564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce809f-9174-456a-a0b1-c0bc97c7132e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.224455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66cc76-ab44-4ab0-a051-f18bc9bc7a5d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.229460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474bff5-e18d-4d90-a8d0-df62952a8bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.230150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474bff5-e18d-4d90-a8d0-df62952a8bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.230427 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474bff5-e18d-4d90-a8d0-df62952a8bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.230695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474bff5-e18d-4d90-a8d0-df62952a8bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.231411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474bff5-e18d-4d90-a8d0-df62952a8bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.232998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474bff5-e18d-4d90-a8d0-df62952a8bc6 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.236920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 771/1570] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:55:59.237893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce809f-9174-456a-a0b1-c0bc97c7132e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.246712 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 800/1571] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:55:59.247554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474bff5-e18d-4d90-a8d0-df62952a8bc6 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.252365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce809f-9174-456a-a0b1-c0bc97c7132e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.258926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474bff5-e18d-4d90-a8d0-df62952a8bc6 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.259182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35870eb3-23a5-4d33-897c-7ec890628965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.259623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35870eb3-23a5-4d33-897c-7ec890628965 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.260131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35870eb3-23a5-4d33-897c-7ec890628965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.260611 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35870eb3-23a5-4d33-897c-7ec890628965 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.261817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35870eb3-23a5-4d33-897c-7ec890628965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:55:59.262428 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35870eb3-23a5-4d33-897c-7ec890628965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.263900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57782380-d9d5-4c01-b8cf-feae253a5b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.264679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782380-d9d5-4c01-b8cf-feae253a5b1d admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.264967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782380-d9d5-4c01-b8cf-feae253a5b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.265244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782380-d9d5-4c01-b8cf-feae253a5b1d admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.265338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35870eb3-23a5-4d33-897c-7ec890628965 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.266013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57782380-d9d5-4c01-b8cf-feae253a5b1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:55:59.266335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57782380-d9d5-4c01-b8cf-feae253a5b1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.268220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57782380-d9d5-4c01-b8cf-feae253a5b1d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.292352 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 772/1572] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:55:59.292603 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 801/1573] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:55:59.292715 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35870eb3-23a5-4d33-897c-7ec890628965 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.292823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57782380-d9d5-4c01-b8cf-feae253a5b1d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.292823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57782380-d9d5-4c01-b8cf-feae253a5b1d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.292982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35870eb3-23a5-4d33-897c-7ec890628965 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.296746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a7007-6dfb-4ef4-b085-a4cdbcaed122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.297244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aabda5-3a0d-41f8-9569-504e30138501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.297411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a7007-6dfb-4ef4-b085-a4cdbcaed122 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.297696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a7007-6dfb-4ef4-b085-a4cdbcaed122 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.297973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a7007-6dfb-4ef4-b085-a4cdbcaed122 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.298423 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aabda5-3a0d-41f8-9569-504e30138501 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.298703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aabda5-3a0d-41f8-9569-504e30138501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.298794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a7007-6dfb-4ef4-b085-a4cdbcaed122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:55:59.298978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aabda5-3a0d-41f8-9569-504e30138501 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.299077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a7007-6dfb-4ef4-b085-a4cdbcaed122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.299657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aabda5-3a0d-41f8-9569-504e30138501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.300592 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a7007-6dfb-4ef4-b085-a4cdbcaed122 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.302292 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aabda5-3a0d-41f8-9569-504e30138501 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.323505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 802/1574] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:55:59.323505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a7007-6dfb-4ef4-b085-a4cdbcaed122 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.328954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a7007-6dfb-4ef4-b085-a4cdbcaed122 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.334072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb4876-d8f5-4e7e-81b7-763cabebae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.339957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4876-d8f5-4e7e-81b7-763cabebae82 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.339957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4876-d8f5-4e7e-81b7-763cabebae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.339957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4876-d8f5-4e7e-81b7-763cabebae82 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.339957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb4876-d8f5-4e7e-81b7-763cabebae82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:55:59.339957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb4876-d8f5-4e7e-81b7-763cabebae82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.339957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb4876-d8f5-4e7e-81b7-763cabebae82 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.351823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 803/1575] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:55:59.352617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb4876-d8f5-4e7e-81b7-763cabebae82 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.366498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb4876-d8f5-4e7e-81b7-763cabebae82 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.372098 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910a6d-79a5-4ec6-a504-e5a1c0f922f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.372784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910a6d-79a5-4ec6-a504-e5a1c0f922f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.373062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910a6d-79a5-4ec6-a504-e5a1c0f922f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.373334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910a6d-79a5-4ec6-a504-e5a1c0f922f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.374134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed910a6d-79a5-4ec6-a504-e5a1c0f922f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.376027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed910a6d-79a5-4ec6-a504-e5a1c0f922f5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.433066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 773/1576] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:55:59 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:55:59.434072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aabda5-3a0d-41f8-9569-504e30138501 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.445185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aabda5-3a0d-41f8-9569-504e30138501 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.449902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a85d6-0dd8-4109-96e9-366e9881dd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.450935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a85d6-0dd8-4109-96e9-366e9881dd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.451289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a85d6-0dd8-4109-96e9-366e9881dd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.451658 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a85d6-0dd8-4109-96e9-366e9881dd36 admin admin] PATH_INFO: `/v3/projects/1c3a7816aa0c4c819a291fb70f389eb6/users/bc967b82732347bd9bf53ebf985e2bef/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.467094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a85d6-0dd8-4109-96e9-366e9881dd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3a7816aa0c4c819a291fb70f389eb6, user_id=bc967b82732347bd9bf53ebf985e2bef, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.470868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 804/1577] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:55:59 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:55:59.470991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING py.warnings [None req-0c3a85d6-0dd8-4109-96e9-366e9881dd36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:55:59.470991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: warnings.warn(msg) Feb 28 21:55:59.470991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: Feb 28 21:55:59.471250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910a6d-79a5-4ec6-a504-e5a1c0f922f5 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.471343 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a85d6-0dd8-4109-96e9-366e9881dd36 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.545875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 774/1578] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:55:59 2022] PUT /identity/v3/projects/1c3a7816aa0c4c819a291fb70f389eb6/users/bc967b82732347bd9bf53ebf985e2bef/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:55:59.545875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a85d6-0dd8-4109-96e9-366e9881dd36 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.546189 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910a6d-79a5-4ec6-a504-e5a1c0f922f5 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.603005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a85d6-0dd8-4109-96e9-366e9881dd36 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.607855 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86fee9-3d73-4a16-aed2-3d878ef866d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.608633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86fee9-3d73-4a16-aed2-3d878ef866d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.608913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86fee9-3d73-4a16-aed2-3d878ef866d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.609186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86fee9-3d73-4a16-aed2-3d878ef866d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.610559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bbb01-3636-4b78-9fcd-9b938639c5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.610705 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86fee9-3d73-4a16-aed2-3d878ef866d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.611448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bbb01-3636-4b78-9fcd-9b938639c5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.611807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bbb01-3636-4b78-9fcd-9b938639c5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.612223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bbb01-3636-4b78-9fcd-9b938639c5f1 admin admin] PATH_INFO: `/v3/projects/98ff64b9ef40408aaa1f8860bbd16b5f/users/4bf68aa698e54763a62cb65727a9e7c3/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.612765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86fee9-3d73-4a16-aed2-3d878ef866d4 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.631095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bbb01-3636-4b78-9fcd-9b938639c5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ff64b9ef40408aaa1f8860bbd16b5f, user_id=4bf68aa698e54763a62cb65727a9e7c3, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.633777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bbb01-3636-4b78-9fcd-9b938639c5f1 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.731293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 775/1579] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:55:59 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:55:59.732953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86fee9-3d73-4a16-aed2-3d878ef866d4 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.750806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 805/1580] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:55:59 2022] PUT /identity/v3/projects/98ff64b9ef40408aaa1f8860bbd16b5f/users/4bf68aa698e54763a62cb65727a9e7c3/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:55:59.751616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bbb01-3636-4b78-9fcd-9b938639c5f1 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.813235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86fee9-3d73-4a16-aed2-3d878ef866d4 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.818236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec8dca-c019-4a1b-a8b2-7d16ccfc1525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.818912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec8dca-c019-4a1b-a8b2-7d16ccfc1525 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.819217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec8dca-c019-4a1b-a8b2-7d16ccfc1525 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.819469 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec8dca-c019-4a1b-a8b2-7d16ccfc1525 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.820167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec8dca-c019-4a1b-a8b2-7d16ccfc1525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.822122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec8dca-c019-4a1b-a8b2-7d16ccfc1525 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.822907 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bbb01-3636-4b78-9fcd-9b938639c5f1 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:55:59.827615 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc1219-ed04-424d-8933-4b46dea714f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:55:59.828294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc1219-ed04-424d-8933-4b46dea714f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:55:59.828577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc1219-ed04-424d-8933-4b46dea714f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:55:59.828850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc1219-ed04-424d-8933-4b46dea714f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:55:59.829543 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc1219-ed04-424d-8933-4b46dea714f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:55:59.831488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc1219-ed04-424d-8933-4b46dea714f3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:55:59.935206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 776/1581] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:55:59 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:55:59.936016 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec8dca-c019-4a1b-a8b2-7d16ccfc1525 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.967677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 806/1582] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:55:59 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:55:59.967677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc1219-ed04-424d-8933-4b46dea714f3 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:55:59.999814 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec8dca-c019-4a1b-a8b2-7d16ccfc1525 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.026741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc1219-ed04-424d-8933-4b46dea714f3 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.032441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cdcbc-b770-4ec2-8b3d-4afc0dab7736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.033096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cdcbc-b770-4ec2-8b3d-4afc0dab7736 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.033376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cdcbc-b770-4ec2-8b3d-4afc0dab7736 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.033652 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727cdcbc-b770-4ec2-8b3d-4afc0dab7736 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.034406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cdcbc-b770-4ec2-8b3d-4afc0dab7736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.036576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727cdcbc-b770-4ec2-8b3d-4afc0dab7736 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.046362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 807/1583] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:00.047242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cdcbc-b770-4ec2-8b3d-4afc0dab7736 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.054960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded6f7a-0caf-4141-8f09-047faa4e077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.055627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded6f7a-0caf-4141-8f09-047faa4e077b admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.055910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded6f7a-0caf-4141-8f09-047faa4e077b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.056191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded6f7a-0caf-4141-8f09-047faa4e077b admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.056884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded6f7a-0caf-4141-8f09-047faa4e077b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.057306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727cdcbc-b770-4ec2-8b3d-4afc0dab7736 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.058839 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded6f7a-0caf-4141-8f09-047faa4e077b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.061865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf564cd-6e89-4d5f-b1d1-89215511e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.062548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf564cd-6e89-4d5f-b1d1-89215511e311 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.062831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf564cd-6e89-4d5f-b1d1-89215511e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.063102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf564cd-6e89-4d5f-b1d1-89215511e311 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.063852 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf564cd-6e89-4d5f-b1d1-89215511e311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.065678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf564cd-6e89-4d5f-b1d1-89215511e311 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.163800 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 777/1584] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:55:59 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:00.165084 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dbd64-389b-4e00-ac28-7fa577e0a30d None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.165366 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dbd64-389b-4e00-ac28-7fa577e0a30d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.165639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dbd64-389b-4e00-ac28-7fa577e0a30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.186567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 808/1585] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:00 2022] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:00.186567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf564cd-6e89-4d5f-b1d1-89215511e311 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.194484 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9e1dbd64-389b-4e00-ac28-7fa577e0a30d None None] MFA Rules not processed for user `bc967b82732347bd9bf53ebf985e2bef`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:00.194484 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9e1dbd64-389b-4e00-ac28-7fa577e0a30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:00.199023 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf564cd-6e89-4d5f-b1d1-89215511e311 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.257152 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 778/1586] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:00.257745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c015-02ed-4d71-bf4e-f04616f125d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.258519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c015-02ed-4d71-bf4e-f04616f125d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.258816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c015-02ed-4d71-bf4e-f04616f125d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.259104 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c015-02ed-4d71-bf4e-f04616f125d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.259519 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f1ba-bcad-4ba2-be66-ad3a70155651 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.259809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f1ba-bcad-4ba2-be66-ad3a70155651 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.260057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9c015-02ed-4d71-bf4e-f04616f125d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.260158 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16f1ba-bcad-4ba2-be66-ad3a70155651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.262133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9c015-02ed-4d71-bf4e-f04616f125d0 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.280586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1d16f1ba-bcad-4ba2-be66-ad3a70155651 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:00.281798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1d16f1ba-bcad-4ba2-be66-ad3a70155651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:00.289404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 779/1587] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:00.290316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f1ba-bcad-4ba2-be66-ad3a70155651 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.299591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16f1ba-bcad-4ba2-be66-ad3a70155651 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.304322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1060c8-e05b-4cb9-9d0a-35eb236ed971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.304972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1060c8-e05b-4cb9-9d0a-35eb236ed971 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.305250 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1060c8-e05b-4cb9-9d0a-35eb236ed971 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.305520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1060c8-e05b-4cb9-9d0a-35eb236ed971 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.306238 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1060c8-e05b-4cb9-9d0a-35eb236ed971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.308150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1060c8-e05b-4cb9-9d0a-35eb236ed971 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.368171 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 809/1588] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:00 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:00.368929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c015-02ed-4d71-bf4e-f04616f125d0 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.378278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c015-02ed-4d71-bf4e-f04616f125d0 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.383498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da1bc-a8f8-4e5f-aa58-57b86dbe2c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.384150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da1bc-a8f8-4e5f-aa58-57b86dbe2c23 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.384436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da1bc-a8f8-4e5f-aa58-57b86dbe2c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.384712 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3da1bc-a8f8-4e5f-aa58-57b86dbe2c23 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.385504 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3da1bc-a8f8-4e5f-aa58-57b86dbe2c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.387461 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3da1bc-a8f8-4e5f-aa58-57b86dbe2c23 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.391747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 780/1589] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:00 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:00.391747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1060c8-e05b-4cb9-9d0a-35eb236ed971 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.401304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1060c8-e05b-4cb9-9d0a-35eb236ed971 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.405780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3da2b-cd91-4d87-baf3-97a034cd3119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.406609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3da2b-cd91-4d87-baf3-97a034cd3119 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.406890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3da2b-cd91-4d87-baf3-97a034cd3119 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.407160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3da2b-cd91-4d87-baf3-97a034cd3119 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.407875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3da2b-cd91-4d87-baf3-97a034cd3119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.409448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3da2b-cd91-4d87-baf3-97a034cd3119 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.419437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 781/1590] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:00.420185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3da2b-cd91-4d87-baf3-97a034cd3119 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.429878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3da2b-cd91-4d87-baf3-97a034cd3119 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.434353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f5367-286f-4453-95a0-52360b6b25c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.434968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f5367-286f-4453-95a0-52360b6b25c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.435248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f5367-286f-4453-95a0-52360b6b25c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.435521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f5367-286f-4453-95a0-52360b6b25c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.436178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f5367-286f-4453-95a0-52360b6b25c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.438108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f5367-286f-4453-95a0-52360b6b25c8 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.486826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 810/1591] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:00 2022] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:00.487729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da1bc-a8f8-4e5f-aa58-57b86dbe2c23 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.498088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3da1bc-a8f8-4e5f-aa58-57b86dbe2c23 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.502760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce0a15-3a5b-4581-8b45-8693b8973517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.503404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0a15-3a5b-4581-8b45-8693b8973517 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.503691 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0a15-3a5b-4581-8b45-8693b8973517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.503960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0a15-3a5b-4581-8b45-8693b8973517 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.505354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce0a15-3a5b-4581-8b45-8693b8973517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.506983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce0a15-3a5b-4581-8b45-8693b8973517 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.517362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 811/1592] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:00.518134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce0a15-3a5b-4581-8b45-8693b8973517 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.527167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce0a15-3a5b-4581-8b45-8693b8973517 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.531754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2712d2-6b0d-4429-ae70-90164b579586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.532405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2712d2-6b0d-4429-ae70-90164b579586 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.532684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2712d2-6b0d-4429-ae70-90164b579586 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.532982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2712d2-6b0d-4429-ae70-90164b579586 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.533656 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2712d2-6b0d-4429-ae70-90164b579586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.535537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2712d2-6b0d-4429-ae70-90164b579586 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.573225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 782/1593] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:00 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:00.574101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f5367-286f-4453-95a0-52360b6b25c8 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.625630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f5367-286f-4453-95a0-52360b6b25c8 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.630136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddc12d-d0a0-4f20-9cf1-6b93f21459f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.630774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddc12d-d0a0-4f20-9cf1-6b93f21459f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.631118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddc12d-d0a0-4f20-9cf1-6b93f21459f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.631470 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddc12d-d0a0-4f20-9cf1-6b93f21459f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.635451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 812/1594] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:00 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:00.635451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2712d2-6b0d-4429-ae70-90164b579586 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.644253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddc12d-d0a0-4f20-9cf1-6b93f21459f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.649213 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddc12d-d0a0-4f20-9cf1-6b93f21459f7 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.655641 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 783/1595] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:00.656265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddc12d-d0a0-4f20-9cf1-6b93f21459f7 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.665219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddc12d-d0a0-4f20-9cf1-6b93f21459f7 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.694454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2712d2-6b0d-4429-ae70-90164b579586 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.699103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc0503-7a51-49cd-bc77-6bab3dbedb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.699762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc0503-7a51-49cd-bc77-6bab3dbedb3d admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.700050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc0503-7a51-49cd-bc77-6bab3dbedb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.700326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc0503-7a51-49cd-bc77-6bab3dbedb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.701065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc0503-7a51-49cd-bc77-6bab3dbedb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.702683 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc0503-7a51-49cd-bc77-6bab3dbedb3d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.712556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 813/1596] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:00.713317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc0503-7a51-49cd-bc77-6bab3dbedb3d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.723870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc0503-7a51-49cd-bc77-6bab3dbedb3d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.724112 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d503-fb19-4f6e-8fd3-84da5496309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.724788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d503-fb19-4f6e-8fd3-84da5496309a admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.725072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d503-fb19-4f6e-8fd3-84da5496309a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.725347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d503-fb19-4f6e-8fd3-84da5496309a admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.726100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868d503-fb19-4f6e-8fd3-84da5496309a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.727706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868d503-fb19-4f6e-8fd3-84da5496309a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.728966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eb479-a967-4e32-8d56-aa70590412b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.729950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eb479-a967-4e32-8d56-aa70590412b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.730322 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eb479-a967-4e32-8d56-aa70590412b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.730755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682eb479-a967-4e32-8d56-aa70590412b4 admin admin] PATH_INFO: `/v3/projects/87811696e9614b2399ccd020af0dc00f/users/815510c6b7584535b91b27235cd995ce/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.741596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 784/1597] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:00.741596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d503-fb19-4f6e-8fd3-84da5496309a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.748897 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682eb479-a967-4e32-8d56-aa70590412b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87811696e9614b2399ccd020af0dc00f, user_id=815510c6b7584535b91b27235cd995ce, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.751664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d503-fb19-4f6e-8fd3-84da5496309a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.751823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682eb479-a967-4e32-8d56-aa70590412b4 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.757458 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977130-91f0-4735-9696-76c36d212c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.773477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977130-91f0-4735-9696-76c36d212c64 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.773477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977130-91f0-4735-9696-76c36d212c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.773477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977130-91f0-4735-9696-76c36d212c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.773477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977130-91f0-4735-9696-76c36d212c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.773477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977130-91f0-4735-9696-76c36d212c64 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.773477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 785/1598] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:00.774053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977130-91f0-4735-9696-76c36d212c64 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.781862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977130-91f0-4735-9696-76c36d212c64 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.787685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b283fec-d95e-49ec-b278-77e813a0b45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.788333 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b283fec-d95e-49ec-b278-77e813a0b45d admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.788663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b283fec-d95e-49ec-b278-77e813a0b45d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.788938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b283fec-d95e-49ec-b278-77e813a0b45d admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.789693 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b283fec-d95e-49ec-b278-77e813a0b45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.791399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b283fec-d95e-49ec-b278-77e813a0b45d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.801358 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 786/1599] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:00.802183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b283fec-d95e-49ec-b278-77e813a0b45d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.811506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b283fec-d95e-49ec-b278-77e813a0b45d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.816353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588047b-821b-4e32-a8ca-180051dbd350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.817037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588047b-821b-4e32-a8ca-180051dbd350 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.817318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588047b-821b-4e32-a8ca-180051dbd350 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.817588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588047b-821b-4e32-a8ca-180051dbd350 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.818502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588047b-821b-4e32-a8ca-180051dbd350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.820205 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a588047b-821b-4e32-a8ca-180051dbd350 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.830714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 787/1600] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:00.831467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588047b-821b-4e32-a8ca-180051dbd350 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.841252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588047b-821b-4e32-a8ca-180051dbd350 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.847948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 814/1601] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:00 2022] PUT /identity/v3/projects/87811696e9614b2399ccd020af0dc00f/users/815510c6b7584535b91b27235cd995ce/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:00.849512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eb479-a967-4e32-8d56-aa70590412b4 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.904536 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099fb4b-09b9-4e5a-b1f8-6fae99bfdb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.905341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099fb4b-09b9-4e5a-b1f8-6fae99bfdb5a admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.905717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099fb4b-09b9-4e5a-b1f8-6fae99bfdb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.906005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099fb4b-09b9-4e5a-b1f8-6fae99bfdb5a admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.906879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099fb4b-09b9-4e5a-b1f8-6fae99bfdb5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.908838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e099fb4b-09b9-4e5a-b1f8-6fae99bfdb5a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.912892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682eb479-a967-4e32-8d56-aa70590412b4 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.917610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66fde4-ee62-4a6a-846f-5908d5cc7824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.919327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66fde4-ee62-4a6a-846f-5908d5cc7824 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.919327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66fde4-ee62-4a6a-846f-5908d5cc7824 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.919327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66fde4-ee62-4a6a-846f-5908d5cc7824 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.922788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66fde4-ee62-4a6a-846f-5908d5cc7824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.922788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66fde4-ee62-4a6a-846f-5908d5cc7824 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.933255 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 815/1602] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:00.934114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66fde4-ee62-4a6a-846f-5908d5cc7824 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.946683 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66fde4-ee62-4a6a-846f-5908d5cc7824 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.952352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df012307-a813-4251-9f68-350f79abc0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.953051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df012307-a813-4251-9f68-350f79abc0dd admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.953383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df012307-a813-4251-9f68-350f79abc0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.953678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df012307-a813-4251-9f68-350f79abc0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.954486 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df012307-a813-4251-9f68-350f79abc0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.956070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df012307-a813-4251-9f68-350f79abc0dd admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.966552 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 816/1603] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:00.969763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df012307-a813-4251-9f68-350f79abc0dd admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.980281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df012307-a813-4251-9f68-350f79abc0dd admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:00.984863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f7792-c297-43b3-a0eb-3286b21c6740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:00.985520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f7792-c297-43b3-a0eb-3286b21c6740 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:00.988431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 788/1604] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:00 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:00.988566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f7792-c297-43b3-a0eb-3286b21c6740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:00.988566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f7792-c297-43b3-a0eb-3286b21c6740 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:00.988752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099fb4b-09b9-4e5a-b1f8-6fae99bfdb5a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:00.988902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f7792-c297-43b3-a0eb-3286b21c6740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:00.988902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f7792-c297-43b3-a0eb-3286b21c6740 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:00.997901 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099fb4b-09b9-4e5a-b1f8-6fae99bfdb5a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:01.002763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 817/1605] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:01.002763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f7792-c297-43b3-a0eb-3286b21c6740 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:01.006589 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465fe63-e70b-4e31-99d2-d60cb557dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:01.007557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465fe63-e70b-4e31-99d2-d60cb557dd57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.007915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465fe63-e70b-4e31-99d2-d60cb557dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.008264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465fe63-e70b-4e31-99d2-d60cb557dd57 admin admin] PATH_INFO: `/v3/projects/932547f6cb2e41b7b4ce5f9744dd1b28/users/979dc554b28140ed85fee864c0a785c0/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.013568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f7792-c297-43b3-a0eb-3286b21c6740 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:01.018527 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079e36f-9c6a-4f72-9964-02a049d250a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:01.022749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e36f-9c6a-4f72-9964-02a049d250a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.022749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e36f-9c6a-4f72-9964-02a049d250a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.022749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079e36f-9c6a-4f72-9964-02a049d250a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.022749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079e36f-9c6a-4f72-9964-02a049d250a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:01.022749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079e36f-9c6a-4f72-9964-02a049d250a9 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:01.025183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465fe63-e70b-4e31-99d2-d60cb557dd57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=932547f6cb2e41b7b4ce5f9744dd1b28, user_id=979dc554b28140ed85fee864c0a785c0, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:01.027896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465fe63-e70b-4e31-99d2-d60cb557dd57 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:01.037228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 818/1606] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:01.037228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fdb10-a154-4bb4-8749-c0fd47fdf79a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.037228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fdb10-a154-4bb4-8749-c0fd47fdf79a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.037228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fdb10-a154-4bb4-8749-c0fd47fdf79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.061782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-508fdb10-a154-4bb4-8749-c0fd47fdf79a None None] MFA Rules not processed for user `815510c6b7584535b91b27235cd995ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:01.063024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-508fdb10-a154-4bb4-8749-c0fd47fdf79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:01.135190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 789/1607] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:00 2022] PUT /identity/v3/projects/932547f6cb2e41b7b4ce5f9744dd1b28/users/979dc554b28140ed85fee864c0a785c0/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:01.135190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465fe63-e70b-4e31-99d2-d60cb557dd57 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:01.142072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 819/1608] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:01.149147 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fdb10-a154-4bb4-8749-c0fd47fdf79a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:01.158273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fdb10-a154-4bb4-8749-c0fd47fdf79a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:01.210233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465fe63-e70b-4e31-99d2-d60cb557dd57 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:01.217591 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a53d9-dac3-4976-ae20-a46538687181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:01.218096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a53d9-dac3-4976-ae20-a46538687181 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.218383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a53d9-dac3-4976-ae20-a46538687181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.218660 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a53d9-dac3-4976-ae20-a46538687181 admin admin] PATH_INFO: `/v3/projects/6d20770e075f46b48eb2fc1a898613e7/users/8c66af0cfab14a74b9290db14f41608e/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.225694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5d623-79a4-4d43-9aa9-612ac52f3924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:01.226627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5d623-79a4-4d43-9aa9-612ac52f3924 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.226904 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5d623-79a4-4d43-9aa9-612ac52f3924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.227187 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5d623-79a4-4d43-9aa9-612ac52f3924 admin admin] PATH_INFO: `/v3/projects/fdca1a6469bf40f180da2e8f5a4b61c6/users/b92aaa59fd1747da9626a8173258d194/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.235889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a53d9-dac3-4976-ae20-a46538687181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d20770e075f46b48eb2fc1a898613e7, user_id=8c66af0cfab14a74b9290db14f41608e, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:01.239599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a53d9-dac3-4976-ae20-a46538687181 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:01.244181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5d623-79a4-4d43-9aa9-612ac52f3924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdca1a6469bf40f180da2e8f5a4b61c6, user_id=b92aaa59fd1747da9626a8173258d194, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:01.247149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5d623-79a4-4d43-9aa9-612ac52f3924 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:01.351520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 820/1609] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:01 2022] PUT /identity/v3/projects/fdca1a6469bf40f180da2e8f5a4b61c6/users/b92aaa59fd1747da9626a8173258d194/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:01.352537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 790/1610] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:01 2022] PUT /identity/v3/projects/6d20770e075f46b48eb2fc1a898613e7/users/8c66af0cfab14a74b9290db14f41608e/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:01.353807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5d623-79a4-4d43-9aa9-612ac52f3924 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:01.356820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a53d9-dac3-4976-ae20-a46538687181 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:01.419049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5d623-79a4-4d43-9aa9-612ac52f3924 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:01.419362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a53d9-dac3-4976-ae20-a46538687181 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:01.424344 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43e2ea-91c6-42fb-a240-7bde42cd214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:01.424507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67c3c6-756c-4f44-a67e-36e40e410eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:01.425324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43e2ea-91c6-42fb-a240-7bde42cd214a admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.425447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c3c6-756c-4f44-a67e-36e40e410eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.425756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c3c6-756c-4f44-a67e-36e40e410eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.426046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43e2ea-91c6-42fb-a240-7bde42cd214a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.426158 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67c3c6-756c-4f44-a67e-36e40e410eb1 admin admin] PATH_INFO: `/v3/projects/4d4175f870b749f7879eaed849d7cc22/users/0f1ce4fe5cb14812a86d5f90520e35e5/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.426597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43e2ea-91c6-42fb-a240-7bde42cd214a admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.427468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43e2ea-91c6-42fb-a240-7bde42cd214a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:01.429349 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43e2ea-91c6-42fb-a240-7bde42cd214a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:01.442778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 821/1611] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:01.442778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43e2ea-91c6-42fb-a240-7bde42cd214a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:01.443370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c3c6-756c-4f44-a67e-36e40e410eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4175f870b749f7879eaed849d7cc22, user_id=0f1ce4fe5cb14812a86d5f90520e35e5, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:01.446252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67c3c6-756c-4f44-a67e-36e40e410eb1 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:01.451266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43e2ea-91c6-42fb-a240-7bde42cd214a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:01.455758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908b564-9fa5-483d-8251-64cccc8d60f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:01.456633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b564-9fa5-483d-8251-64cccc8d60f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.456912 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b564-9fa5-483d-8251-64cccc8d60f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.457184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908b564-9fa5-483d-8251-64cccc8d60f3 admin admin] PATH_INFO: `/v3/projects/9d7b8fd839a54e2882b1f4263b69f08d/users/d139f4b0679c490b811aadb41639bcd7/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.472378 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908b564-9fa5-483d-8251-64cccc8d60f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7b8fd839a54e2882b1f4263b69f08d, user_id=d139f4b0679c490b811aadb41639bcd7, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:01.479934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908b564-9fa5-483d-8251-64cccc8d60f3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:01.528103 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 791/1612] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:01 2022] PUT /identity/v3/projects/4d4175f870b749f7879eaed849d7cc22/users/0f1ce4fe5cb14812a86d5f90520e35e5/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:01.529560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1126-662d-4ee0-8708-05c69a3d7427 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.529983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1126-662d-4ee0-8708-05c69a3d7427 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.530274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1126-662d-4ee0-8708-05c69a3d7427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.573076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 822/1613] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:01 2022] PUT /identity/v3/projects/9d7b8fd839a54e2882b1f4263b69f08d/users/d139f4b0679c490b811aadb41639bcd7/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:01.573076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e52ed-a6db-49bd-80f9-280a9d9ca869 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.573076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e52ed-a6db-49bd-80f9-280a9d9ca869 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.573076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e52ed-a6db-49bd-80f9-280a9d9ca869 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.573076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 823/1614] 10.222.0.26 () {54 vars in 961 bytes} [Mon Feb 28 21:56:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:56:01.573639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-903a1126-662d-4ee0-8708-05c69a3d7427 None None] MFA Rules not processed for user `979dc554b28140ed85fee864c0a785c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:01.575449 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-903a1126-662d-4ee0-8708-05c69a3d7427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:01.576446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c83fe-5dc2-48da-9c16-21fb273619e4 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.576586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c83fe-5dc2-48da-9c16-21fb273619e4 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.576884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c83fe-5dc2-48da-9c16-21fb273619e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.599430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e33c83fe-5dc2-48da-9c16-21fb273619e4 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:01.600849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e33c83fe-5dc2-48da-9c16-21fb273619e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:01.666052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 792/1615] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:01.666204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b64e90-a1a9-4b3c-955b-33dcd7f6806b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.666498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b64e90-a1a9-4b3c-955b-33dcd7f6806b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.666780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b64e90-a1a9-4b3c-955b-33dcd7f6806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.689967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 824/1616] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:01.697840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c83fe-5dc2-48da-9c16-21fb273619e4 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:01.698023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-75b64e90-a1a9-4b3c-955b-33dcd7f6806b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:01.698023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-75b64e90-a1a9-4b3c-955b-33dcd7f6806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:01.701835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c83fe-5dc2-48da-9c16-21fb273619e4 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:01.704916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 793/1617] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:01.706043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388918da-946f-4064-bef6-7f990ecbcead None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.706333 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388918da-946f-4064-bef6-7f990ecbcead None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.706610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388918da-946f-4064-bef6-7f990ecbcead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.710265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22193a9a-db79-455d-89cc-17522c3e666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:01.711328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22193a9a-db79-455d-89cc-17522c3e666a admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.711612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22193a9a-db79-455d-89cc-17522c3e666a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.711890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22193a9a-db79-455d-89cc-17522c3e666a admin admin] PATH_INFO: `/v3/projects/ba85599f059646dead3edb4153ce3909/users/b077a444757b40aba9cdddcc0d3229c2/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.728573 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22193a9a-db79-455d-89cc-17522c3e666a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba85599f059646dead3edb4153ce3909, user_id=b077a444757b40aba9cdddcc0d3229c2, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:01.731371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22193a9a-db79-455d-89cc-17522c3e666a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:01.735922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-388918da-946f-4064-bef6-7f990ecbcead None None] MFA Rules not processed for user `0f1ce4fe5cb14812a86d5f90520e35e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:01.737136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-388918da-946f-4064-bef6-7f990ecbcead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:01.798342 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 794/1618] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:01.799710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ebc8c-da7c-4bd7-b416-8ae27e38c8fb None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.799999 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ebc8c-da7c-4bd7-b416-8ae27e38c8fb None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.800388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ebc8c-da7c-4bd7-b416-8ae27e38c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.803740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 825/1619] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:01 2022] PUT /identity/v3/projects/ba85599f059646dead3edb4153ce3909/users/b077a444757b40aba9cdddcc0d3229c2/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:01.805100 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ec470-835d-4a81-8761-7e229ecb8b40 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.805492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ec470-835d-4a81-8761-7e229ecb8b40 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.805868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ec470-835d-4a81-8761-7e229ecb8b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.819886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ed7ebc8c-da7c-4bd7-b416-8ae27e38c8fb None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:01.821179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ed7ebc8c-da7c-4bd7-b416-8ae27e38c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:01.833735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-051ec470-835d-4a81-8761-7e229ecb8b40 None None] MFA Rules not processed for user `d139f4b0679c490b811aadb41639bcd7`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:01.835047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-051ec470-835d-4a81-8761-7e229ecb8b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:01.891678 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 795/1620] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Feb 28 21:56:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:01.892744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ebc8c-da7c-4bd7-b416-8ae27e38c8fb None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:01.907228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 826/1621] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:01.908085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ec470-835d-4a81-8761-7e229ecb8b40 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:01.909625 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-051ec470-835d-4a81-8761-7e229ecb8b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:01.954812 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ebc8c-da7c-4bd7-b416-8ae27e38c8fb None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:01.960365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31520c-e311-4b90-bb67-5317c2e38941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:01.961108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31520c-e311-4b90-bb67-5317c2e38941 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.961489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31520c-e311-4b90-bb67-5317c2e38941 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.962389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31520c-e311-4b90-bb67-5317c2e38941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:01.984661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ec470-835d-4a81-8761-7e229ecb8b40 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:01.990576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269a837-d7bc-49b8-b44b-165912ada3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:01.991250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269a837-d7bc-49b8-b44b-165912ada3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:01.991531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269a837-d7bc-49b8-b44b-165912ada3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:01.991832 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269a837-d7bc-49b8-b44b-165912ada3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.032799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31520c-e311-4b90-bb67-5317c2e38941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.034276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31520c-e311-4b90-bb67-5317c2e38941 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.055266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 796/1622] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:02.058404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31520c-e311-4b90-bb67-5317c2e38941 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:02.061225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269a837-d7bc-49b8-b44b-165912ada3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.063526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269a837-d7bc-49b8-b44b-165912ada3d9 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.074983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31520c-e311-4b90-bb67-5317c2e38941 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:02.079601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 827/1623] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:02.080645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269a837-d7bc-49b8-b44b-165912ada3d9 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:02.081665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10bace-334a-428a-ab72-93f230631703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:02.082951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10bace-334a-428a-ab72-93f230631703 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.083378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10bace-334a-428a-ab72-93f230631703 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.083656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10bace-334a-428a-ab72-93f230631703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.098966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269a837-d7bc-49b8-b44b-165912ada3d9 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:02.099223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10bace-334a-428a-ab72-93f230631703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.100797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10bace-334a-428a-ab72-93f230631703 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.104724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f8850-15e3-40cd-a6f1-e51e719ab6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:02.105638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f8850-15e3-40cd-a6f1-e51e719ab6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.105929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f8850-15e3-40cd-a6f1-e51e719ab6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.106777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f8850-15e3-40cd-a6f1-e51e719ab6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.107928 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f8850-15e3-40cd-a6f1-e51e719ab6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.109905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f8850-15e3-40cd-a6f1-e51e719ab6e7 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.111690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 797/1624] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:02.112592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10bace-334a-428a-ab72-93f230631703 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:02.123510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10bace-334a-428a-ab72-93f230631703 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:02.128541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea976d9-bb3d-473b-b750-b63a44c1fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:02.129725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea976d9-bb3d-473b-b750-b63a44c1fc20 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.129725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea976d9-bb3d-473b-b750-b63a44c1fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.130260 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea976d9-bb3d-473b-b750-b63a44c1fc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.131092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea976d9-bb3d-473b-b750-b63a44c1fc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.132784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea976d9-bb3d-473b-b750-b63a44c1fc20 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.143610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 798/1625] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:02.145651 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea976d9-bb3d-473b-b750-b63a44c1fc20 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:02.159398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea976d9-bb3d-473b-b750-b63a44c1fc20 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:02.165551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d63dc-f5f2-47b0-9e06-c78d2037a05f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:02.166296 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d63dc-f5f2-47b0-9e06-c78d2037a05f service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.166586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d63dc-f5f2-47b0-9e06-c78d2037a05f service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.166847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d63dc-f5f2-47b0-9e06-c78d2037a05f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.196435 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 828/1626] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:02 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:02.196435 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496267-8dca-4ee6-b925-0a991124a769 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.197003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496267-8dca-4ee6-b925-0a991124a769 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.197331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c496267-8dca-4ee6-b925-0a991124a769 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.202805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 829/1627] 10.222.0.26 () {54 vars in 961 bytes} [Mon Feb 28 21:56:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:56:02.205715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c496267-8dca-4ee6-b925-0a991124a769 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:02.257798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d63dc-f5f2-47b0-9e06-c78d2037a05f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.259862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d63dc-f5f2-47b0-9e06-c78d2037a05f service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.271697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 799/1628] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:02.272313 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d63dc-f5f2-47b0-9e06-c78d2037a05f service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:02.283946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d63dc-f5f2-47b0-9e06-c78d2037a05f service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:02.356492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c496267-8dca-4ee6-b925-0a991124a769 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:02.363422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e47584-2cd7-4945-a6da-7cdea5f0415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:02.366153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22325c17-c5ed-46f4-8ba2-86f5239535c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:02.366916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e47584-2cd7-4945-a6da-7cdea5f0415f admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.367347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e47584-2cd7-4945-a6da-7cdea5f0415f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.367738 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e47584-2cd7-4945-a6da-7cdea5f0415f admin admin] PATH_INFO: `/v3/projects/ba85599f059646dead3edb4153ce3909/users/b077a444757b40aba9cdddcc0d3229c2/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.367857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22325c17-c5ed-46f4-8ba2-86f5239535c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.368265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22325c17-c5ed-46f4-8ba2-86f5239535c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.368701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22325c17-c5ed-46f4-8ba2-86f5239535c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.369545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22325c17-c5ed-46f4-8ba2-86f5239535c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.371083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e47584-2cd7-4945-a6da-7cdea5f0415f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba85599f059646dead3edb4153ce3909, user_id=b077a444757b40aba9cdddcc0d3229c2, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.372183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22325c17-c5ed-46f4-8ba2-86f5239535c7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.374468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e47584-2cd7-4945-a6da-7cdea5f0415f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.393221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 830/1629] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:02 2022] PUT /identity/v3/projects/ba85599f059646dead3edb4153ce3909/users/b077a444757b40aba9cdddcc0d3229c2/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:02.395007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60c912-55ab-4882-abf1-1902f45b50b4 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.395881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60c912-55ab-4882-abf1-1902f45b50b4 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.396300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60c912-55ab-4882-abf1-1902f45b50b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.431046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ba60c912-55ab-4882-abf1-1902f45b50b4 None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:02.432926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ba60c912-55ab-4882-abf1-1902f45b50b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:02.511292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 831/1630] 10.222.0.26 () {58 vars in 1058 bytes} [Mon Feb 28 21:56:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:02.512571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2073ea3-b7a5-4f79-b5ad-49d577cfeb6c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.512857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2073ea3-b7a5-4f79-b5ad-49d577cfeb6c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.513134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2073ea3-b7a5-4f79-b5ad-49d577cfeb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.549346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b2073ea3-b7a5-4f79-b5ad-49d577cfeb6c None None] MFA Rules not processed for user `b077a444757b40aba9cdddcc0d3229c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:02.550760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b2073ea3-b7a5-4f79-b5ad-49d577cfeb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:02.585206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 800/1631] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:02 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:02.585206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22325c17-c5ed-46f4-8ba2-86f5239535c7 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:02.661416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 832/1632] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:02 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:02.663205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a2246-6bbc-4efc-bb62-07d0325e282e None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.663205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a2246-6bbc-4efc-bb62-07d0325e282e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.663423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a2246-6bbc-4efc-bb62-07d0325e282e None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.665708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 833/1633] 10.222.0.26 () {54 vars in 912 bytes} [Mon Feb 28 21:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:56:02.665922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a2246-6bbc-4efc-bb62-07d0325e282e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:02.693920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22325c17-c5ed-46f4-8ba2-86f5239535c7 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:02.700016 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7536e-d596-4923-ac10-0f3b310350a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:02.700702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7536e-d596-4923-ac10-0f3b310350a0 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.700993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7536e-d596-4923-ac10-0f3b310350a0 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.701589 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7536e-d596-4923-ac10-0f3b310350a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.761086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a2246-6bbc-4efc-bb62-07d0325e282e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:02.767840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a431fb-6709-44da-975e-2aefcdf2da7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:02.770638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a431fb-6709-44da-975e-2aefcdf2da7c admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.770638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a431fb-6709-44da-975e-2aefcdf2da7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.771542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a431fb-6709-44da-975e-2aefcdf2da7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.771902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a431fb-6709-44da-975e-2aefcdf2da7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.774317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a431fb-6709-44da-975e-2aefcdf2da7c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.791223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 834/1634] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:02.796213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf255a-39de-49e5-9186-9fdd3ed2581a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.796665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf255a-39de-49e5-9186-9fdd3ed2581a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.797048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf255a-39de-49e5-9186-9fdd3ed2581a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.807283 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7536e-d596-4923-ac10-0f3b310350a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.808924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7536e-d596-4923-ac10-0f3b310350a0 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.822416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 801/1635] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:02.823286 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7536e-d596-4923-ac10-0f3b310350a0 service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:02.848987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4daf255a-39de-49e5-9186-9fdd3ed2581a None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:02.859198 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4daf255a-39de-49e5-9186-9fdd3ed2581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:02.883970 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 835/1636] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 21:56:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:02.885067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf255a-39de-49e5-9186-9fdd3ed2581a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:02.909291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf255a-39de-49e5-9186-9fdd3ed2581a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:02.921959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b53088-0c81-401b-ae5f-d8a0cdc8f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:02.923290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53088-0c81-401b-ae5f-d8a0cdc8f757 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.925138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53088-0c81-401b-ae5f-d8a0cdc8f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.926156 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b53088-0c81-401b-ae5f-d8a0cdc8f757 admin admin] PATH_INFO: `/v3/projects/bc96eb81558243b4965af0724959ecd5/users/5eaa49e27c1d41cd8c7578b0ef4e34ce/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.933136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7536e-d596-4923-ac10-0f3b310350a0 service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:02.936067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5be6d8-210f-4f57-b9d1-1f3ffdcb3331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:02.936724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5be6d8-210f-4f57-b9d1-1f3ffdcb3331 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:02.937172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5be6d8-210f-4f57-b9d1-1f3ffdcb3331 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:02.937533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5be6d8-210f-4f57-b9d1-1f3ffdcb3331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:02.948480 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5be6d8-210f-4f57-b9d1-1f3ffdcb3331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.951726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5be6d8-210f-4f57-b9d1-1f3ffdcb3331 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:02.970024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 802/1637] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:02 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:02.970565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b53088-0c81-401b-ae5f-d8a0cdc8f757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc96eb81558243b4965af0724959ecd5, user_id=5eaa49e27c1d41cd8c7578b0ef4e34ce, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:02.980652 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b53088-0c81-401b-ae5f-d8a0cdc8f757 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:03.072756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 836/1638] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:02 2022] PUT /identity/v3/projects/bc96eb81558243b4965af0724959ecd5/users/5eaa49e27c1d41cd8c7578b0ef4e34ce/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:03.077649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5be6d8-210f-4f57-b9d1-1f3ffdcb3331 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:03.104829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5be6d8-210f-4f57-b9d1-1f3ffdcb3331 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:03.156930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b53088-0c81-401b-ae5f-d8a0cdc8f757 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:03.262553 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532aea91-cc25-4be7-ae3f-a0b776ba49c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:03.273562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aea91-cc25-4be7-ae3f-a0b776ba49c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:03.275940 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aea91-cc25-4be7-ae3f-a0b776ba49c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:03.276403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aea91-cc25-4be7-ae3f-a0b776ba49c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:03.277340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532aea91-cc25-4be7-ae3f-a0b776ba49c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:03.279952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532aea91-cc25-4be7-ae3f-a0b776ba49c4 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:03.306173 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 803/1639] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:03.306173 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532aea91-cc25-4be7-ae3f-a0b776ba49c4 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:03.314295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b53088-0c81-401b-ae5f-d8a0cdc8f757 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:03.315227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532aea91-cc25-4be7-ae3f-a0b776ba49c4 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:03.318725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530b6bf-71fb-41dd-b585-5d6b10536908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:03.319372 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b6bf-71fb-41dd-b585-5d6b10536908 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:03.319644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b6bf-71fb-41dd-b585-5d6b10536908 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:03.319918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b6bf-71fb-41dd-b585-5d6b10536908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:03.323419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963d065-f3e5-4f7a-8869-a7a70498fdae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:03.324312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963d065-f3e5-4f7a-8869-a7a70498fdae service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:03.324788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963d065-f3e5-4f7a-8869-a7a70498fdae service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:03.325226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963d065-f3e5-4f7a-8869-a7a70498fdae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:03.392763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530b6bf-71fb-41dd-b585-5d6b10536908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:03.394280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530b6bf-71fb-41dd-b585-5d6b10536908 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:03.406276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 804/1640] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:03.407726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ae44-a6dc-439c-a1fc-efbb074c9713 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:03.408009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ae44-a6dc-439c-a1fc-efbb074c9713 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:03.408281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ae44-a6dc-439c-a1fc-efbb074c9713 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:03.410427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 805/1641] 10.222.0.26 () {54 vars in 912 bytes} [Mon Feb 28 21:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:56:03.411669 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ae44-a6dc-439c-a1fc-efbb074c9713 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:03.433837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ae44-a6dc-439c-a1fc-efbb074c9713 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:03.442831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963d065-f3e5-4f7a-8869-a7a70498fdae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:03.445012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963d065-f3e5-4f7a-8869-a7a70498fdae service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:03.450996 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e3237-63e8-401c-9a8f-6ada7f37d398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:03.450996 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e3237-63e8-401c-9a8f-6ada7f37d398 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:03.450996 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e3237-63e8-401c-9a8f-6ada7f37d398 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:03.450996 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e3237-63e8-401c-9a8f-6ada7f37d398 admin admin] PATH_INFO: `/v3/projects/bc96eb81558243b4965af0724959ecd5/users/5eaa49e27c1d41cd8c7578b0ef4e34ce/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:03.454702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e3237-63e8-401c-9a8f-6ada7f37d398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc96eb81558243b4965af0724959ecd5, user_id=5eaa49e27c1d41cd8c7578b0ef4e34ce, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:03.459604 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e3237-63e8-401c-9a8f-6ada7f37d398 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:03.468555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 837/1642] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:03.471144 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e8246-7650-48fe-8996-2850efd7b6fc None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:03.472633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e8246-7650-48fe-8996-2850efd7b6fc None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:03.472910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e8246-7650-48fe-8996-2850efd7b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:03.483077 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 806/1643] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:03 2022] PUT /identity/v3/projects/bc96eb81558243b4965af0724959ecd5/users/5eaa49e27c1d41cd8c7578b0ef4e34ce/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:03.493391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ba927-59de-4628-bac3-ff64daa9c067 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:03.493720 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ba927-59de-4628-bac3-ff64daa9c067 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:03.493946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ba927-59de-4628-bac3-ff64daa9c067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:03.522668 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-9f9e8246-7650-48fe-8996-2850efd7b6fc None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:03.528022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9f9e8246-7650-48fe-8996-2850efd7b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:03.580603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-da6ba927-59de-4628-bac3-ff64daa9c067 None None] MFA Rules not processed for user `5eaa49e27c1d41cd8c7578b0ef4e34ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:03.580603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-da6ba927-59de-4628-bac3-ff64daa9c067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:03.684549 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 838/1644] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 21:56:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:03.700341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 807/1645] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:04.496357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e8246-7650-48fe-8996-2850efd7b6fc None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:04.522632 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3982cc9-3171-4f96-971c-e7d53b3e1867 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:04.523223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3982cc9-3171-4f96-971c-e7d53b3e1867 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:04.523223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3982cc9-3171-4f96-971c-e7d53b3e1867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:04.563545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-e3982cc9-3171-4f96-971c-e7d53b3e1867 None None] MFA Rules not processed for user `8c66af0cfab14a74b9290db14f41608e`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:04.567946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e3982cc9-3171-4f96-971c-e7d53b3e1867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:04.626672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e8246-7650-48fe-8996-2850efd7b6fc None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:04.637441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96ede1-54bd-4a62-bba9-4b9fba4ad574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:04.638317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ede1-54bd-4a62-bba9-4b9fba4ad574 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:04.638841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ede1-54bd-4a62-bba9-4b9fba4ad574 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:04.640394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96ede1-54bd-4a62-bba9-4b9fba4ad574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:04.673547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96ede1-54bd-4a62-bba9-4b9fba4ad574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:04.675275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96ede1-54bd-4a62-bba9-4b9fba4ad574 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:04.691329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 839/1646] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:04.694936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96ede1-54bd-4a62-bba9-4b9fba4ad574 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:04.704947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96ede1-54bd-4a62-bba9-4b9fba4ad574 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:04.711501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5182fd-9807-40eb-9f1d-d2966e981999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:04.712890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5182fd-9807-40eb-9f1d-d2966e981999 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:04.713411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5182fd-9807-40eb-9f1d-d2966e981999 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:04.728669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5182fd-9807-40eb-9f1d-d2966e981999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:04.728669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5182fd-9807-40eb-9f1d-d2966e981999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:04.729289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5182fd-9807-40eb-9f1d-d2966e981999 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:04.730246 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 808/1647] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:04.733018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ae82-b9e1-40e5-85ef-74342f18e282 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:04.733798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ae82-b9e1-40e5-85ef-74342f18e282 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:04.734508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4ae82-b9e1-40e5-85ef-74342f18e282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:04.742578 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 840/1648] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:04.763047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-eee4ae82-b9e1-40e5-85ef-74342f18e282 None None] MFA Rules not processed for user `8c66af0cfab14a74b9290db14f41608e`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:04.764331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-eee4ae82-b9e1-40e5-85ef-74342f18e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:04.783017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 809/1649] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:04.892063 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5182fd-9807-40eb-9f1d-d2966e981999 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:04.912777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5182fd-9807-40eb-9f1d-d2966e981999 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:04.920170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb83c41-da6e-48ca-99c9-5157df06a585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:04.922679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83c41-da6e-48ca-99c9-5157df06a585 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:04.923144 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83c41-da6e-48ca-99c9-5157df06a585 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:04.924242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb83c41-da6e-48ca-99c9-5157df06a585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:04.943719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb83c41-da6e-48ca-99c9-5157df06a585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:04.946223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb83c41-da6e-48ca-99c9-5157df06a585 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:04.961494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 841/1650] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:56:05.071504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ae82-b9e1-40e5-85ef-74342f18e282 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:05.161244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb83c41-da6e-48ca-99c9-5157df06a585 service nova] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:05.172540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4ae82-b9e1-40e5-85ef-74342f18e282 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:05.178920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:05.180328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:05.181699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb83c41-da6e-48ca-99c9-5157df06a585 service nova] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:05.182326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:05.182624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] PATH_INFO: `/v3/users/d139f4b0679c490b811aadb41639bcd7` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:05.185828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d139f4b0679c490b811aadb41639bcd7)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:05.185828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: WARNING py.warnings [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:56:05.185828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: warnings.warn(msg) Feb 28 21:56:05.185828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: Feb 28 21:56:05.186876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:05.188294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc03288-cc54-4b27-94bf-4cab82ea578c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:05.188983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc03288-cc54-4b27-94bf-4cab82ea578c service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:05.189260 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc03288-cc54-4b27-94bf-4cab82ea578c service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:05.189528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc03288-cc54-4b27-94bf-4cab82ea578c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:05.299523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc03288-cc54-4b27-94bf-4cab82ea578c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:05.301081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc03288-cc54-4b27-94bf-4cab82ea578c service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:05.315310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 842/1651] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:05.465564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e314b-6ade-4409-9f02-1e5d39eaac9a None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:05.466256 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e314b-6ade-4409-9f02-1e5d39eaac9a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:05.466633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e314b-6ade-4409-9f02-1e5d39eaac9a None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:05.469205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 843/1652] 10.222.0.26 () {54 vars in 912 bytes} [Mon Feb 28 21:56:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:56:05.478119 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d340-ad43-476d-bb91-855c283f69c5 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:05.478559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d340-ad43-476d-bb91-855c283f69c5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:05.479057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d340-ad43-476d-bb91-855c283f69c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:05.617841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd139f4b0679c490b811aadb41639bcd7'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:05.617841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd139f4b0679c490b811aadb41639bcd7'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:05.619093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-1fa5d340-ad43-476d-bb91-855c283f69c5 None None] MFA Rules not processed for user `b4664710493b462bafae3908c582e9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:05.619093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1fa5d340-ad43-476d-bb91-855c283f69c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:05.672185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd139f4b0679c490b811aadb41639bcd7'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:05.707476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd139f4b0679c490b811aadb41639bcd7'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:05.750966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a994aa81-6491-4db9-9c25-1803580c13cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd139f4b0679c490b811aadb41639bcd7'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:05.771075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 810/1653] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:05 2022] DELETE /identity/v3/users/d139f4b0679c490b811aadb41639bcd7 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:05.781642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0a91d-686b-41f5-bcf4-8e6d7c356bc8 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:05.782290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0a91d-686b-41f5-bcf4-8e6d7c356bc8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:05.782799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0a91d-686b-41f5-bcf4-8e6d7c356bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:05.785053 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 844/1654] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:05.813235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-97b0a91d-686b-41f5-bcf4-8e6d7c356bc8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:05.818749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d340-ad43-476d-bb91-855c283f69c5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:05.819424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-97b0a91d-686b-41f5-bcf4-8e6d7c356bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:05.822826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1fa5d340-ad43-476d-bb91-855c283f69c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:05.839551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d340-ad43-476d-bb91-855c283f69c5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:05.940770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 811/1655] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:05.987599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0a91d-686b-41f5-bcf4-8e6d7c356bc8 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:05.989199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7afaf8-c1fc-4462-9411-79080b722f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:05.990141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-97b0a91d-686b-41f5-bcf4-8e6d7c356bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:05.990619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7afaf8-c1fc-4462-9411-79080b722f16 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:05.991055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7afaf8-c1fc-4462-9411-79080b722f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:05.991508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7afaf8-c1fc-4462-9411-79080b722f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:06.005687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7afaf8-c1fc-4462-9411-79080b722f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:06.007433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7afaf8-c1fc-4462-9411-79080b722f16 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:06.016275 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0a91d-686b-41f5-bcf4-8e6d7c356bc8 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:06.028245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 845/1656] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:06.038684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8535f-b4f4-40a3-91f4-a89c30c0aa27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:06.038684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8535f-b4f4-40a3-91f4-a89c30c0aa27 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:06.038684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8535f-b4f4-40a3-91f4-a89c30c0aa27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:06.038684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8535f-b4f4-40a3-91f4-a89c30c0aa27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:06.049377 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8535f-b4f4-40a3-91f4-a89c30c0aa27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:06.052020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8535f-b4f4-40a3-91f4-a89c30c0aa27 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:06.075409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 812/1657] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:56:07.156133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c222321-20de-49fe-81f4-7aaf4fe372e4 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:07.156751 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c222321-20de-49fe-81f4-7aaf4fe372e4 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:07.156929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c222321-20de-49fe-81f4-7aaf4fe372e4 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:07.161243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 846/1658] 10.222.0.26 () {54 vars in 960 bytes} [Mon Feb 28 21:56:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:56:07.171028 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a13c-1269-4fa6-94c3-86d88cc45924 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:07.172418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a13c-1269-4fa6-94c3-86d88cc45924 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:07.172914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78a13c-1269-4fa6-94c3-86d88cc45924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:07.232202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-3b78a13c-1269-4fa6-94c3-86d88cc45924 None None] MFA Rules not processed for user `1875af7b72b247c9a2b5e1f2b2fb1eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:07.236675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3b78a13c-1269-4fa6-94c3-86d88cc45924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:07.359701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c222321-20de-49fe-81f4-7aaf4fe372e4 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:07.362981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 813/1659] 10.222.0.26 () {58 vars in 1057 bytes} [Mon Feb 28 21:56:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:07.380058 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c222321-20de-49fe-81f4-7aaf4fe372e4 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:07.436550 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff45d8d-06db-4ec3-838b-09a2ee8b66ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1875af7b72b247c9a2b5e1f2b2fb1eaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:07.438354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff45d8d-06db-4ec3-838b-09a2ee8b66ae service placement] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:07.438757 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff45d8d-06db-4ec3-838b-09a2ee8b66ae service placement] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:07.440184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff45d8d-06db-4ec3-838b-09a2ee8b66ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:07.701975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2ff45d8d-06db-4ec3-838b-09a2ee8b66ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:07.701975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff45d8d-06db-4ec3-838b-09a2ee8b66ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:07.701975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff45d8d-06db-4ec3-838b-09a2ee8b66ae service placement] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:07.701975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 847/1660] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:56:07.704256 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78a13c-1269-4fa6-94c3-86d88cc45924 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:07.704256 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3b78a13c-1269-4fa6-94c3-86d88cc45924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:07.704256 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78a13c-1269-4fa6-94c3-86d88cc45924 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:07.704708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:07.704708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:07.704708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:07.704708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] PATH_INFO: `/v3/projects/9d7b8fd839a54e2882b1f4263b69f08d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:07.706557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7b8fd839a54e2882b1f4263b69f08d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:07.706557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:07.872248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7b8fd839a54e2882b1f4263b69f08d', 'request_id': 'req-00ad87c7-5e61-4bae-bab5-ffbc9396497c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:07.889972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7b8fd839a54e2882b1f4263b69f08d', 'request_id': 'req-00ad87c7-5e61-4bae-bab5-ffbc9396497c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:07.901401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7b8fd839a54e2882b1f4263b69f08d', 'request_id': 'req-00ad87c7-5e61-4bae-bab5-ffbc9396497c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:08.002408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] The token cache is being invalidate because project 9d7b8fd839a54e2882b1f4263b69f08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:08.002723 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:08.008947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-00ad87c7-5e61-4bae-bab5-ffbc9396497c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:08.014079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 814/1661] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:07 2022] DELETE /identity/v3/projects/9d7b8fd839a54e2882b1f4263b69f08d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:08.016797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3c6a1-b2d2-4bbf-a7e0-1f82bc7e40d1 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:08.019527 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3c6a1-b2d2-4bbf-a7e0-1f82bc7e40d1 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:08.019819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3c6a1-b2d2-4bbf-a7e0-1f82bc7e40d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:08.050458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-dea3c6a1-b2d2-4bbf-a7e0-1f82bc7e40d1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:08.053767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-dea3c6a1-b2d2-4bbf-a7e0-1f82bc7e40d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:08.138332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 848/1662] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:08.152900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a05822-4981-44dd-b730-3b1d3b65a565 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:08.153301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a05822-4981-44dd-b730-3b1d3b65a565 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:08.153649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a05822-4981-44dd-b730-3b1d3b65a565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:08.202216 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-c9a05822-4981-44dd-b730-3b1d3b65a565 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:08.203548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c9a05822-4981-44dd-b730-3b1d3b65a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:08.222789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3c6a1-b2d2-4bbf-a7e0-1f82bc7e40d1 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:08.227026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 815/1663] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:08.234795 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3c6a1-b2d2-4bbf-a7e0-1f82bc7e40d1 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:08.241761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc30eb1-1e11-4431-89c3-050145fb01cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:08.243257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc30eb1-1e11-4431-89c3-050145fb01cb admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:08.243712 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc30eb1-1e11-4431-89c3-050145fb01cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:08.244128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc30eb1-1e11-4431-89c3-050145fb01cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:08.245026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc30eb1-1e11-4431-89c3-050145fb01cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:08.245480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc30eb1-1e11-4431-89c3-050145fb01cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:08.247367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc30eb1-1e11-4431-89c3-050145fb01cb admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:08.271747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a05822-4981-44dd-b730-3b1d3b65a565 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:08.276849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 849/1664] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:56:08.287092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a05822-4981-44dd-b730-3b1d3b65a565 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:08.313010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c5e5b-a31a-4fae-b3d9-b78e7e2d016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:08.316501 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5e5b-a31a-4fae-b3d9-b78e7e2d016d admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:08.317101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5e5b-a31a-4fae-b3d9-b78e7e2d016d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:08.317101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5e5b-a31a-4fae-b3d9-b78e7e2d016d admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:08.317928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c5e5b-a31a-4fae-b3d9-b78e7e2d016d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:08.341793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c5e5b-a31a-4fae-b3d9-b78e7e2d016d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:08.569759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc30eb1-1e11-4431-89c3-050145fb01cb admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:08.570518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 816/1665] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:08 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:08.595862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc30eb1-1e11-4431-89c3-050145fb01cb admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:08.793566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d054da-d2e4-4ba2-8f23-c4d7c0a357eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:08.794388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d054da-d2e4-4ba2-8f23-c4d7c0a357eb admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:08.794567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d054da-d2e4-4ba2-8f23-c4d7c0a357eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:08.795029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d054da-d2e4-4ba2-8f23-c4d7c0a357eb admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:08.795723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d054da-d2e4-4ba2-8f23-c4d7c0a357eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:08.797782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d054da-d2e4-4ba2-8f23-c4d7c0a357eb admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:08.895760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 850/1666] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:08 2022] POST /identity/v3/users => generated 287 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:08.899800 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c5e5b-a31a-4fae-b3d9-b78e7e2d016d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:08.920799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c5e5b-a31a-4fae-b3d9-b78e7e2d016d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:08.934308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55022d-e446-407c-9a85-b87c4abf9341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:08.934998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55022d-e446-407c-9a85-b87c4abf9341 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:08.935586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55022d-e446-407c-9a85-b87c4abf9341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:08.936013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55022d-e446-407c-9a85-b87c4abf9341 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:08.949062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55022d-e446-407c-9a85-b87c4abf9341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:08.950993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55022d-e446-407c-9a85-b87c4abf9341 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:08.982878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 817/1667] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:08.987049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d054da-d2e4-4ba2-8f23-c4d7c0a357eb admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:09.006785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d054da-d2e4-4ba2-8f23-c4d7c0a357eb admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:09.016657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff21eb-6929-471c-a7ee-cfbc42afdbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:09.017751 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff21eb-6929-471c-a7ee-cfbc42afdbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:09.018386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff21eb-6929-471c-a7ee-cfbc42afdbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:09.018816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff21eb-6929-471c-a7ee-cfbc42afdbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:09.020540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff21eb-6929-471c-a7ee-cfbc42afdbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:09.023405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff21eb-6929-471c-a7ee-cfbc42afdbc3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:09.046468 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55022d-e446-407c-9a85-b87c4abf9341 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:09.046790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 851/1668] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:09.078972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55022d-e446-407c-9a85-b87c4abf9341 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:09.091308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793db0a-5662-41f2-ade8-f9cdfeb07305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:09.092253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793db0a-5662-41f2-ade8-f9cdfeb07305 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:09.092763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793db0a-5662-41f2-ade8-f9cdfeb07305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:09.093245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793db0a-5662-41f2-ade8-f9cdfeb07305 admin admin] PATH_INFO: `/v3/projects/1dea36fb51ea4159a0cb518c026e8859/users/2c586371cf474cbda107b6babed757b9/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:09.128174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793db0a-5662-41f2-ade8-f9cdfeb07305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dea36fb51ea4159a0cb518c026e8859, user_id=2c586371cf474cbda107b6babed757b9, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:09.131951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793db0a-5662-41f2-ade8-f9cdfeb07305 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:09.254925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 818/1669] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:09 2022] PUT /identity/v3/projects/1dea36fb51ea4159a0cb518c026e8859/users/2c586371cf474cbda107b6babed757b9/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:09.266751 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221b70-9e3a-40d7-a91a-c9c549386cae None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:09.267682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221b70-9e3a-40d7-a91a-c9c549386cae None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:09.268164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221b70-9e3a-40d7-a91a-c9c549386cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:09.311367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-99221b70-9e3a-40d7-a91a-c9c549386cae None None] MFA Rules not processed for user `2c586371cf474cbda107b6babed757b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:09.314203 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-99221b70-9e3a-40d7-a91a-c9c549386cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:09.522621 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 852/1670] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:09.526613 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793db0a-5662-41f2-ade8-f9cdfeb07305 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:09.666026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793db0a-5662-41f2-ade8-f9cdfeb07305 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:09.681664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df982919-4c29-47b0-a9c9-c2954e9bd3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:09.683010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df982919-4c29-47b0-a9c9-c2954e9bd3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:09.683379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df982919-4c29-47b0-a9c9-c2954e9bd3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:09.683730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df982919-4c29-47b0-a9c9-c2954e9bd3a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:09.684718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df982919-4c29-47b0-a9c9-c2954e9bd3a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:09.687534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df982919-4c29-47b0-a9c9-c2954e9bd3a8 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:09.837547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 819/1671] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:09 2022] POST /identity/v3/projects => generated 373 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:09.838952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221b70-9e3a-40d7-a91a-c9c549386cae None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:09.864619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221b70-9e3a-40d7-a91a-c9c549386cae None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:09.954292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4083d-0974-4857-9a68-e22b8280542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:09.955209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4083d-0974-4857-9a68-e22b8280542a admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:09.955559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4083d-0974-4857-9a68-e22b8280542a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:09.955968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4083d-0974-4857-9a68-e22b8280542a admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:09.956746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4083d-0974-4857-9a68-e22b8280542a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:09.965394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4083d-0974-4857-9a68-e22b8280542a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:09.971407 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd125-98df-452d-9917-4dcdf303147b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:09.977697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd125-98df-452d-9917-4dcdf303147b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:09.978241 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd125-98df-452d-9917-4dcdf303147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:10.042023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-971bd125-98df-452d-9917-4dcdf303147b None None] MFA Rules not processed for user `4bf68aa698e54763a62cb65727a9e7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:10.043579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-971bd125-98df-452d-9917-4dcdf303147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:10.089301 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 853/1672] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:09 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:10.092789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4083d-0974-4857-9a68-e22b8280542a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:10.115752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4083d-0974-4857-9a68-e22b8280542a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:10.124393 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e3d1-716c-4434-99b3-8c2e5ac98219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:10.125326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e3d1-716c-4434-99b3-8c2e5ac98219 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:10.125900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e3d1-716c-4434-99b3-8c2e5ac98219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:10.126332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e3d1-716c-4434-99b3-8c2e5ac98219 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:10.127796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06e3d1-716c-4434-99b3-8c2e5ac98219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:10.130404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06e3d1-716c-4434-99b3-8c2e5ac98219 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:10.133355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 820/1673] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:10.143426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8cac4-622e-48b5-9105-ccb866609de8 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:10.148863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8cac4-622e-48b5-9105-ccb866609de8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:10.149204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 854/1674] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:10.149306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8cac4-622e-48b5-9105-ccb866609de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:10.160965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e3d1-716c-4434-99b3-8c2e5ac98219 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:10.173518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-b4f8cac4-622e-48b5-9105-ccb866609de8 None None] MFA Rules not processed for user `4bf68aa698e54763a62cb65727a9e7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:10.177661 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b4f8cac4-622e-48b5-9105-ccb866609de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:10.184863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e3d1-716c-4434-99b3-8c2e5ac98219 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:10.188077 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 821/1675] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:10.192363 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e631f71-e181-4e04-a8fc-5ed400adf811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:10.193547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e631f71-e181-4e04-a8fc-5ed400adf811 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:10.193982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e631f71-e181-4e04-a8fc-5ed400adf811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:10.194460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e631f71-e181-4e04-a8fc-5ed400adf811 admin admin] PATH_INFO: `/v3/projects/0b3ca7806e84497f8cf3891784d21823/users/1e51d59ed5a2437da77e64781d6f504f/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:10.199467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8cac4-622e-48b5-9105-ccb866609de8 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:10.200910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b4f8cac4-622e-48b5-9105-ccb866609de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:10.219797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e631f71-e181-4e04-a8fc-5ed400adf811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3ca7806e84497f8cf3891784d21823, user_id=1e51d59ed5a2437da77e64781d6f504f, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:10.222254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e631f71-e181-4e04-a8fc-5ed400adf811 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:10.307812 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8cac4-622e-48b5-9105-ccb866609de8 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:10.315491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd59d7d-f003-4718-87c9-bb08c66dc066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:10.316367 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59d7d-f003-4718-87c9-bb08c66dc066 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:10.316828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59d7d-f003-4718-87c9-bb08c66dc066 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:10.317434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59d7d-f003-4718-87c9-bb08c66dc066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:10.331444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd59d7d-f003-4718-87c9-bb08c66dc066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:10.334236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd59d7d-f003-4718-87c9-bb08c66dc066 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:10.362981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 822/1676] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:56:10.375681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 855/1677] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:10 2022] PUT /identity/v3/projects/0b3ca7806e84497f8cf3891784d21823/users/1e51d59ed5a2437da77e64781d6f504f/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:10.382317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd59d7d-f003-4718-87c9-bb08c66dc066 service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:10.397967 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd59d7d-f003-4718-87c9-bb08c66dc066 service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:10.506317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28449a-b971-4685-8536-fc70c56c90e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:10.507100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28449a-b971-4685-8536-fc70c56c90e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:10.507455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28449a-b971-4685-8536-fc70c56c90e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:10.507799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28449a-b971-4685-8536-fc70c56c90e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:10.508612 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28449a-b971-4685-8536-fc70c56c90e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:10.510351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28449a-b971-4685-8536-fc70c56c90e7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:10.526017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e631f71-e181-4e04-a8fc-5ed400adf811 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:10.526526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 823/1678] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:10.546697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e631f71-e181-4e04-a8fc-5ed400adf811 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:10.557851 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55414a-d851-42a0-a672-73bc8d53bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:10.560709 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55414a-d851-42a0-a672-73bc8d53bfca admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:10.561532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55414a-d851-42a0-a672-73bc8d53bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:10.561821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55414a-d851-42a0-a672-73bc8d53bfca admin admin] PATH_INFO: `/v3/projects/0b3ca7806e84497f8cf3891784d21823/users/1e51d59ed5a2437da77e64781d6f504f/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:10.567633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55414a-d851-42a0-a672-73bc8d53bfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3ca7806e84497f8cf3891784d21823, user_id=1e51d59ed5a2437da77e64781d6f504f, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:10.570801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55414a-d851-42a0-a672-73bc8d53bfca admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:10.593714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 856/1679] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:10 2022] PUT /identity/v3/projects/0b3ca7806e84497f8cf3891784d21823/users/1e51d59ed5a2437da77e64781d6f504f/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:10.597488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dd579-7ad0-478f-9229-b24d78b1d299 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:10.598078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dd579-7ad0-478f-9229-b24d78b1d299 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:10.598779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dd579-7ad0-478f-9229-b24d78b1d299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:10.636204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ff9dd579-7ad0-478f-9229-b24d78b1d299 None None] MFA Rules not processed for user `1e51d59ed5a2437da77e64781d6f504f`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:10.637854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ff9dd579-7ad0-478f-9229-b24d78b1d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:10.759901 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 824/1680] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:10.767697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55414a-d851-42a0-a672-73bc8d53bfca admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:10.770412 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4f55414a-d851-42a0-a672-73bc8d53bfca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:10.891949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55414a-d851-42a0-a672-73bc8d53bfca admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:10.910335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25794b0-ac6b-4f55-bc96-dc4e6ffdd7c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:10.912069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25794b0-ac6b-4f55-bc96-dc4e6ffdd7c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:10.915866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25794b0-ac6b-4f55-bc96-dc4e6ffdd7c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:10.916259 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25794b0-ac6b-4f55-bc96-dc4e6ffdd7c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:10.939638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25794b0-ac6b-4f55-bc96-dc4e6ffdd7c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:10.945542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25794b0-ac6b-4f55-bc96-dc4e6ffdd7c7 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:10.967829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 857/1681] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:11.363120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dd579-7ad0-478f-9229-b24d78b1d299 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:11.365758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ff9dd579-7ad0-478f-9229-b24d78b1d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:11.386549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dd579-7ad0-478f-9229-b24d78b1d299 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:11.402317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ac7ee-0ec2-4ed4-8742-94607528090f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:11.403880 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ac7ee-0ec2-4ed4-8742-94607528090f service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:11.406271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ac7ee-0ec2-4ed4-8742-94607528090f service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:11.406883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ac7ee-0ec2-4ed4-8742-94607528090f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:11.563972 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925349e-0916-4b79-92b0-4fdf370f8a33 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:11.564571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925349e-0916-4b79-92b0-4fdf370f8a33 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:11.564661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925349e-0916-4b79-92b0-4fdf370f8a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:11.635943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ac7ee-0ec2-4ed4-8742-94607528090f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:11.638229 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ac7ee-0ec2-4ed4-8742-94607528090f service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:11.648533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-5925349e-0916-4b79-92b0-4fdf370f8a33 None None] MFA Rules not processed for user `4bf68aa698e54763a62cb65727a9e7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:11.652764 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5925349e-0916-4b79-92b0-4fdf370f8a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:11.663926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 825/1682] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:11.809072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 858/1683] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:11.842504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ac7ee-0ec2-4ed4-8742-94607528090f service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:11.843959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-cc5ac7ee-0ec2-4ed4-8742-94607528090f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:12.012979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ac7ee-0ec2-4ed4-8742-94607528090f service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:12.018395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:12.019418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:12.020174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:12.020650 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] PATH_INFO: `/v3/users/bc967b82732347bd9bf53ebf985e2bef` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:12.022447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc967b82732347bd9bf53ebf985e2bef)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:12.026215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:12.075829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12348eb5-b325-4825-9f25-3a95345a45e5 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:12.076172 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12348eb5-b325-4825-9f25-3a95345a45e5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:12.076625 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12348eb5-b325-4825-9f25-3a95345a45e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:12.120688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-12348eb5-b325-4825-9f25-3a95345a45e5 None None] MFA Rules not processed for user `b92aaa59fd1747da9626a8173258d194`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:12.121910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-12348eb5-b325-4825-9f25-3a95345a45e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:12.233967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 859/1684] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:12.254772 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc967b82732347bd9bf53ebf985e2bef'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:12.258936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc967b82732347bd9bf53ebf985e2bef'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:12.303911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12348eb5-b325-4825-9f25-3a95345a45e5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:12.304745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-12348eb5-b325-4825-9f25-3a95345a45e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:12.339712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc967b82732347bd9bf53ebf985e2bef'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:12.350160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc967b82732347bd9bf53ebf985e2bef'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:12.382416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-463d5c17-bfb0-4cb9-b491-63e141c4c1c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc967b82732347bd9bf53ebf985e2bef'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:12.395027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 826/1685] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:11 2022] DELETE /identity/v3/users/bc967b82732347bd9bf53ebf985e2bef => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:12.399118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a5db-3a11-4a38-b18e-bb1badd4ac32 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:12.399512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a5db-3a11-4a38-b18e-bb1badd4ac32 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:12.399937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a5db-3a11-4a38-b18e-bb1badd4ac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:12.435744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12348eb5-b325-4825-9f25-3a95345a45e5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:12.441496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-4f65a5db-3a11-4a38-b18e-bb1badd4ac32 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:12.444094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4f65a5db-3a11-4a38-b18e-bb1badd4ac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:12.542577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 827/1686] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:12.553480 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65a5db-3a11-4a38-b18e-bb1badd4ac32 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:12.556466 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4f65a5db-3a11-4a38-b18e-bb1badd4ac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:12.563930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356582d2-b77c-4857-8d6a-d2196a31860a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:12.564686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356582d2-b77c-4857-8d6a-d2196a31860a service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:12.565267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356582d2-b77c-4857-8d6a-d2196a31860a service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:12.565267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356582d2-b77c-4857-8d6a-d2196a31860a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:12.570863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-356582d2-b77c-4857-8d6a-d2196a31860a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:12.673181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65a5db-3a11-4a38-b18e-bb1badd4ac32 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:12.684209 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87458f39-15e2-4a32-b85d-d2f15e15e6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:12.684993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458f39-15e2-4a32-b85d-d2f15e15e6fd service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:12.685354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458f39-15e2-4a32-b85d-d2f15e15e6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:12.686578 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458f39-15e2-4a32-b85d-d2f15e15e6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:12.686771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356582d2-b77c-4857-8d6a-d2196a31860a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:12.688663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356582d2-b77c-4857-8d6a-d2196a31860a service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:12.699334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 860/1687] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:56:12.702342 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87458f39-15e2-4a32-b85d-d2f15e15e6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:12.704147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87458f39-15e2-4a32-b85d-d2f15e15e6fd service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:12.735756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 828/1688] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:13.610707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356582d2-b77c-4857-8d6a-d2196a31860a service nova] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:13.643228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-356582d2-b77c-4857-8d6a-d2196a31860a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:13.654727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356582d2-b77c-4857-8d6a-d2196a31860a service nova] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:13.691001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:13.692542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:13.692813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:13.717483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] PATH_INFO: `/v3/projects/1c3a7816aa0c4c819a291fb70f389eb6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:13.721457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3a7816aa0c4c819a291fb70f389eb6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:13.727752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: WARNING py.warnings [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 28 21:56:13.727752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: warnings.warn(msg) Feb 28 21:56:13.727752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: Feb 28 21:56:13.730192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:14.023548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3a7816aa0c4c819a291fb70f389eb6', 'request_id': 'req-cc276ebc-f218-4dfd-995d-90d1fb0bad98'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:14.043225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3a7816aa0c4c819a291fb70f389eb6', 'request_id': 'req-cc276ebc-f218-4dfd-995d-90d1fb0bad98'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:14.174214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3a7816aa0c4c819a291fb70f389eb6', 'request_id': 'req-cc276ebc-f218-4dfd-995d-90d1fb0bad98'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:14.191792 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] The token cache is being invalidate because project 1c3a7816aa0c4c819a291fb70f389eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:14.192435 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:14.193288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cc276ebc-f218-4dfd-995d-90d1fb0bad98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:14.195434 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 861/1689] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:13 2022] DELETE /identity/v3/projects/1c3a7816aa0c4c819a291fb70f389eb6 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:14.199771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87458f39-15e2-4a32-b85d-d2f15e15e6fd service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:14.212787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87458f39-15e2-4a32-b85d-d2f15e15e6fd service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:14.334376 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:14.337098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:14.337614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:14.338055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] PATH_INFO: `/v3/users/b077a444757b40aba9cdddcc0d3229c2` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:14.340289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b077a444757b40aba9cdddcc0d3229c2)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:14.342830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:14.637605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b077a444757b40aba9cdddcc0d3229c2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:14.639227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b077a444757b40aba9cdddcc0d3229c2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:14.742036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b077a444757b40aba9cdddcc0d3229c2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:14.764067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b077a444757b40aba9cdddcc0d3229c2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:14.821108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b077a444757b40aba9cdddcc0d3229c2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:14.842769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 829/1690] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:14 2022] DELETE /identity/v3/users/b077a444757b40aba9cdddcc0d3229c2 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:15.123829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d879c-fea1-435d-98eb-73dc5d1923c0 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:15.124373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d879c-fea1-435d-98eb-73dc5d1923c0 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:15.124531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d879c-fea1-435d-98eb-73dc5d1923c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:15.169741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2a9d879c-fea1-435d-98eb-73dc5d1923c0 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:15.175281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2a9d879c-fea1-435d-98eb-73dc5d1923c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:15.389159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 862/1691] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 21:56:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:15.939661 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:15.941263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:16.106672 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedb2f3-7aee-4740-87fa-c6eefee0ce24 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:16.112802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13db1f7-3b80-4096-a668-ddaf440df3fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:16.114329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13db1f7-3b80-4096-a668-ddaf440df3fd service swift] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:16.114747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13db1f7-3b80-4096-a668-ddaf440df3fd service swift] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:16.115368 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13db1f7-3b80-4096-a668-ddaf440df3fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:16.128365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13db1f7-3b80-4096-a668-ddaf440df3fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:16.130625 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13db1f7-3b80-4096-a668-ddaf440df3fd service swift] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:16.153319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 830/1692] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 21:56:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 21:56:16.497092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d879c-fea1-435d-98eb-73dc5d1923c0 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:16.498911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2a9d879c-fea1-435d-98eb-73dc5d1923c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:16.876215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d879c-fea1-435d-98eb-73dc5d1923c0 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:16.888267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:16.892197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:16.892713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:16.893156 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] PATH_INFO: `/v3/projects/ba85599f059646dead3edb4153ce3909` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:16.899838 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba85599f059646dead3edb4153ce3909)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:16.904998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:17.072345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13db1f7-3b80-4096-a668-ddaf440df3fd service swift] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:17.074397 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d13db1f7-3b80-4096-a668-ddaf440df3fd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:17.107348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13db1f7-3b80-4096-a668-ddaf440df3fd service swift] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:17.131633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba85599f059646dead3edb4153ce3909', 'request_id': 'req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:17.146886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba85599f059646dead3edb4153ce3909', 'request_id': 'req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:17.255370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba85599f059646dead3edb4153ce3909', 'request_id': 'req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:17.277108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] The token cache is being invalidate because project ba85599f059646dead3edb4153ce3909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:17.277308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:17.278708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5d6a8176-0f61-42fd-9c32-8e7e2eebb9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:17.286901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 863/1693] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:16 2022] DELETE /identity/v3/projects/ba85599f059646dead3edb4153ce3909 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:17.288348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:17.289259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:17.289541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:17.289809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] PATH_INFO: `/v3/users/815510c6b7584535b91b27235cd995ce` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:17.291052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=815510c6b7584535b91b27235cd995ce)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:17.292497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5c6db-d904-45a8-9c9a-5718e0901520 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:17.292831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5c6db-d904-45a8-9c9a-5718e0901520 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:17.292975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:17.293110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5c6db-d904-45a8-9c9a-5718e0901520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:17.343016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-81f5c6db-d904-45a8-9c9a-5718e0901520 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:17.344841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-81f5c6db-d904-45a8-9c9a-5718e0901520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:17.362863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 864/1694] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:17.366730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8fd02-cade-4f5b-bdc3-fcf5dc7ff7ac None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:17.367134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8fd02-cade-4f5b-bdc3-fcf5dc7ff7ac None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:17.367511 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8fd02-cade-4f5b-bdc3-fcf5dc7ff7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:17.413115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-37d8fd02-cade-4f5b-bdc3-fcf5dc7ff7ac None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:17.415590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-37d8fd02-cade-4f5b-bdc3-fcf5dc7ff7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:17.433356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 865/1695] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:17.434513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8fd02-cade-4f5b-bdc3-fcf5dc7ff7ac None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:17.447422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8fd02-cade-4f5b-bdc3-fcf5dc7ff7ac None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:17.452959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558a0f4-081b-4a52-b684-5b4475f7fe78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:17.453626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558a0f4-081b-4a52-b684-5b4475f7fe78 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:17.454017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558a0f4-081b-4a52-b684-5b4475f7fe78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:17.454320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558a0f4-081b-4a52-b684-5b4475f7fe78 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:17.456038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558a0f4-081b-4a52-b684-5b4475f7fe78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:17.456656 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558a0f4-081b-4a52-b684-5b4475f7fe78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:17.459878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558a0f4-081b-4a52-b684-5b4475f7fe78 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:17.487334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 866/1696] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:56:17.489109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558a0f4-081b-4a52-b684-5b4475f7fe78 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:17.506784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558a0f4-081b-4a52-b684-5b4475f7fe78 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:17.513775 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cffc4-8d69-4d00-a10f-0e06446a791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:17.514476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cffc4-8d69-4d00-a10f-0e06446a791e admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:17.514835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cffc4-8d69-4d00-a10f-0e06446a791e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:17.521521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cffc4-8d69-4d00-a10f-0e06446a791e admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:17.521521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cffc4-8d69-4d00-a10f-0e06446a791e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:17.521521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cffc4-8d69-4d00-a10f-0e06446a791e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:17.542227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '815510c6b7584535b91b27235cd995ce'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:17.546858 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '815510c6b7584535b91b27235cd995ce'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:17.646605 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 867/1697] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:17 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:17.647950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cffc4-8d69-4d00-a10f-0e06446a791e admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:17.670558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '815510c6b7584535b91b27235cd995ce'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:17.678551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '815510c6b7584535b91b27235cd995ce'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:17.701903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-04c3593d-358c-45c6-8fb2-343102b77ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '815510c6b7584535b91b27235cd995ce'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:17.717763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 831/1698] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:17 2022] DELETE /identity/v3/users/815510c6b7584535b91b27235cd995ce => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:17.721309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc2236-e28c-41d9-aa88-f50d8270c996 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:17.727836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc2236-e28c-41d9-aa88-f50d8270c996 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:17.727836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc2236-e28c-41d9-aa88-f50d8270c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:17.759609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cffc4-8d69-4d00-a10f-0e06446a791e admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:17.790034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-accc2236-e28c-41d9-aa88-f50d8270c996 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:17.792046 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-accc2236-e28c-41d9-aa88-f50d8270c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:17.848839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5421b-48c8-42a3-b862-308a181ce9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:17.849844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5421b-48c8-42a3-b862-308a181ce9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:17.850345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5421b-48c8-42a3-b862-308a181ce9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:17.856141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5421b-48c8-42a3-b862-308a181ce9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:17.857376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5421b-48c8-42a3-b862-308a181ce9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:17.860661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5421b-48c8-42a3-b862-308a181ce9e2 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:17.891137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 832/1699] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:17.911737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc2236-e28c-41d9-aa88-f50d8270c996 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:17.913701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-accc2236-e28c-41d9-aa88-f50d8270c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:18.014428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 868/1700] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:17 2022] POST /identity/v3/users => generated 294 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:18.017422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5421b-48c8-42a3-b862-308a181ce9e2 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:18.022723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-26f5421b-48c8-42a3-b862-308a181ce9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:18.044733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5421b-48c8-42a3-b862-308a181ce9e2 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:18.057143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b5d40-89d3-4f69-8a17-37afc02d0511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:18.058658 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b5d40-89d3-4f69-8a17-37afc02d0511 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:18.059035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b5d40-89d3-4f69-8a17-37afc02d0511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:18.059314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b5d40-89d3-4f69-8a17-37afc02d0511 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:18.060350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b5d40-89d3-4f69-8a17-37afc02d0511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:18.061930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b5d40-89d3-4f69-8a17-37afc02d0511 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:18.071288 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc2236-e28c-41d9-aa88-f50d8270c996 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:18.075541 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 869/1701] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:18.079874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b5d40-89d3-4f69-8a17-37afc02d0511 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:18.094562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b5d40-89d3-4f69-8a17-37afc02d0511 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:18.103210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4642a6-7dc6-4b8e-b68b-f3403f8b8674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:18.104849 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4642a6-7dc6-4b8e-b68b-f3403f8b8674 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:18.105374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40e0a4-a595-4217-8438-93f8f1fc72bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:18.106237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40e0a4-a595-4217-8438-93f8f1fc72bf admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:18.106559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40e0a4-a595-4217-8438-93f8f1fc72bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:18.106832 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40e0a4-a595-4217-8438-93f8f1fc72bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:18.107179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4642a6-7dc6-4b8e-b68b-f3403f8b8674 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:18.107612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40e0a4-a595-4217-8438-93f8f1fc72bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:18.107962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4642a6-7dc6-4b8e-b68b-f3403f8b8674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:18.109653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40e0a4-a595-4217-8438-93f8f1fc72bf admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:18.122138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 870/1702] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:18.130274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40e0a4-a595-4217-8438-93f8f1fc72bf admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:18.134428 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4642a6-7dc6-4b8e-b68b-f3403f8b8674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:18.136071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4642a6-7dc6-4b8e-b68b-f3403f8b8674 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:18.141459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40e0a4-a595-4217-8438-93f8f1fc72bf admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:18.147574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e45ee2-c52d-4410-9020-98582d11a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:18.148488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e45ee2-c52d-4410-9020-98582d11a5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:18.148772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e45ee2-c52d-4410-9020-98582d11a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:18.149042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e45ee2-c52d-4410-9020-98582d11a5a3 admin admin] PATH_INFO: `/v3/projects/c1352a60cbc142b3b9192e80ca1dbe31/users/cceca27349a5443c857583fdaeeb8fc8/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:18.150352 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 833/1703] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:18.167789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e45ee2-c52d-4410-9020-98582d11a5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1352a60cbc142b3b9192e80ca1dbe31, user_id=cceca27349a5443c857583fdaeeb8fc8, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:18.170532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e45ee2-c52d-4410-9020-98582d11a5a3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:18.334344 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 871/1704] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:18 2022] PUT /identity/v3/projects/c1352a60cbc142b3b9192e80ca1dbe31/users/cceca27349a5443c857583fdaeeb8fc8/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:18.335609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136108f1-63d9-48ec-a804-59d00565896a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:18.335900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136108f1-63d9-48ec-a804-59d00565896a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:18.336399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136108f1-63d9-48ec-a804-59d00565896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:18.396324 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-136108f1-63d9-48ec-a804-59d00565896a None None] MFA Rules not processed for user `cceca27349a5443c857583fdaeeb8fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:18.397886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-136108f1-63d9-48ec-a804-59d00565896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:18.539400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 834/1705] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:18.543534 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e45ee2-c52d-4410-9020-98582d11a5a3 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:18.685663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e45ee2-c52d-4410-9020-98582d11a5a3 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:18.704080 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7fc75-b6c8-40e7-8400-16dcfb5708c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:18.704759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fc75-b6c8-40e7-8400-16dcfb5708c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:18.705045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fc75-b6c8-40e7-8400-16dcfb5708c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:18.705367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fc75-b6c8-40e7-8400-16dcfb5708c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:18.706490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7fc75-b6c8-40e7-8400-16dcfb5708c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:18.708144 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7fc75-b6c8-40e7-8400-16dcfb5708c8 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:19.650117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136108f1-63d9-48ec-a804-59d00565896a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:19.653900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-136108f1-63d9-48ec-a804-59d00565896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:19.656740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 872/1706] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:18 2022] POST /identity/v3/projects => generated 385 bytes in 1114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:19.662679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7fc75-b6c8-40e7-8400-16dcfb5708c8 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:19.690051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136108f1-63d9-48ec-a804-59d00565896a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:19.790885 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7fc75-b6c8-40e7-8400-16dcfb5708c8 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:19.795438 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:19.796393 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:19.796680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:19.796955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] PATH_INFO: `/v3/projects/87811696e9614b2399ccd020af0dc00f` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:19.798338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=87811696e9614b2399ccd020af0dc00f)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:19.800280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:19.814574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bd99b-0432-43ee-92f1-5d81f18f5430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:19.815376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd99b-0432-43ee-92f1-5d81f18f5430 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:19.818629 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd99b-0432-43ee-92f1-5d81f18f5430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:19.819007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd99b-0432-43ee-92f1-5d81f18f5430 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:19.819813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bd99b-0432-43ee-92f1-5d81f18f5430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:19.822229 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bd99b-0432-43ee-92f1-5d81f18f5430 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:20.004238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 873/1707] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:19 2022] POST /identity/v3/users => generated 299 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:20.006360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa3d7-751f-4730-bc7f-83ef993cc3c9 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.006732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa3d7-751f-4730-bc7f-83ef993cc3c9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.007149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa3d7-751f-4730-bc7f-83ef993cc3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.026878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-1faaa3d7-751f-4730-bc7f-83ef993cc3c9 None None] MFA Rules not processed for user `b92aaa59fd1747da9626a8173258d194`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:20.028092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1faaa3d7-751f-4730-bc7f-83ef993cc3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:20.043117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87811696e9614b2399ccd020af0dc00f', 'request_id': 'req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:20.050698 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87811696e9614b2399ccd020af0dc00f', 'request_id': 'req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:20.057415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87811696e9614b2399ccd020af0dc00f', 'request_id': 'req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:20.089017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 874/1708] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:20.089967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaa3d7-751f-4730-bc7f-83ef993cc3c9 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:20.149578 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] The token cache is being invalidate because project 87811696e9614b2399ccd020af0dc00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:20.150187 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:20.153461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9fae650a-6bd7-4a18-98c1-c2d52f276a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:20.155605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 835/1709] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:19 2022] DELETE /identity/v3/projects/87811696e9614b2399ccd020af0dc00f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:20.161058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ebb5-f59d-473d-9025-1e7735e61b72 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.161494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ebb5-f59d-473d-9025-1e7735e61b72 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.161954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626ebb5-f59d-473d-9025-1e7735e61b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.188730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-7626ebb5-f59d-473d-9025-1e7735e61b72 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:20.190302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7626ebb5-f59d-473d-9025-1e7735e61b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:20.204338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 836/1710] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:20.210397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaa3d7-751f-4730-bc7f-83ef993cc3c9 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:20.214644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ce164-a6f9-403e-b991-f951e6918ead None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.214936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ce164-a6f9-403e-b991-f951e6918ead None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.215212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ce164-a6f9-403e-b991-f951e6918ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.217157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650b6a7-8d1d-42c8-a133-5170363e1ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:20.236796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9d8ce164-a6f9-403e-b991-f951e6918ead None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:20.238232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9d8ce164-a6f9-403e-b991-f951e6918ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:20.241380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650b6a7-8d1d-42c8-a133-5170363e1ccf admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.241657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650b6a7-8d1d-42c8-a133-5170363e1ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.241933 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650b6a7-8d1d-42c8-a133-5170363e1ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.249965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650b6a7-8d1d-42c8-a133-5170363e1ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:20.249965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650b6a7-8d1d-42c8-a133-5170363e1ccf admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:20.252355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 837/1711] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:20.253467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ce164-a6f9-403e-b991-f951e6918ead None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:20.258037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 875/1712] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:20.261726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650b6a7-8d1d-42c8-a133-5170363e1ccf admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:20.263792 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1650b6a7-8d1d-42c8-a133-5170363e1ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:20.265302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ce164-a6f9-403e-b991-f951e6918ead None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:20.271050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c18ba3-772c-4820-bdf2-c6541b6b147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:20.271806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c18ba3-772c-4820-bdf2-c6541b6b147b admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.272155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c18ba3-772c-4820-bdf2-c6541b6b147b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.272939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c18ba3-772c-4820-bdf2-c6541b6b147b admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.277461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c18ba3-772c-4820-bdf2-c6541b6b147b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:20.279770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650b6a7-8d1d-42c8-a133-5170363e1ccf admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:20.280013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c18ba3-772c-4820-bdf2-c6541b6b147b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:20.281948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c18ba3-772c-4820-bdf2-c6541b6b147b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:20.289568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c545-9956-49c7-bd08-6f5e104558ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:20.289568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c545-9956-49c7-bd08-6f5e104558ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.289568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c545-9956-49c7-bd08-6f5e104558ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.289568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c545-9956-49c7-bd08-6f5e104558ea admin admin] PATH_INFO: `/v3/projects/80899ca824c8421180d47be89be427ad/users/8ea3ce8ac9904ab39632bea80cebe2b1/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.306417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 838/1713] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:56:20.310683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c18ba3-772c-4820-bdf2-c6541b6b147b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:20.310871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5c545-9956-49c7-bd08-6f5e104558ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=80899ca824c8421180d47be89be427ad, user_id=8ea3ce8ac9904ab39632bea80cebe2b1, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:20.313594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5c545-9956-49c7-bd08-6f5e104558ea admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:20.328935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c18ba3-772c-4820-bdf2-c6541b6b147b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:20.337757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda90b4-bcac-40fc-996f-b31326f27e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:20.341850 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda90b4-bcac-40fc-996f-b31326f27e69 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.341850 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda90b4-bcac-40fc-996f-b31326f27e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.341850 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda90b4-bcac-40fc-996f-b31326f27e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.341850 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda90b4-bcac-40fc-996f-b31326f27e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:20.343209 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda90b4-bcac-40fc-996f-b31326f27e69 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:20.476121 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 876/1714] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:20 2022] PUT /identity/v3/projects/80899ca824c8421180d47be89be427ad/users/8ea3ce8ac9904ab39632bea80cebe2b1/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:20.476121 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c545-9956-49c7-bd08-6f5e104558ea admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:20.586485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c545-9956-49c7-bd08-6f5e104558ea admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:20.593952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e62ac-ba48-4b03-abf8-ebb8bafd5be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:20.595214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e62ac-ba48-4b03-abf8-ebb8bafd5be7 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.595665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e62ac-ba48-4b03-abf8-ebb8bafd5be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.596149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e62ac-ba48-4b03-abf8-ebb8bafd5be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.597051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e62ac-ba48-4b03-abf8-ebb8bafd5be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:20.600031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e62ac-ba48-4b03-abf8-ebb8bafd5be7 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:20.614525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 877/1715] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:20.690729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 839/1716] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:20 2022] POST /identity/v3/projects => generated 373 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:20.691192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158635a6-de26-4236-a7ec-bae92a0138c1 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.691192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158635a6-de26-4236-a7ec-bae92a0138c1 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.691192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158635a6-de26-4236-a7ec-bae92a0138c1 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.691192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 878/1717] 10.222.0.26 () {54 vars in 912 bytes} [Mon Feb 28 21:56:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:56:20.692079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62e3cb-8090-442b-842e-0940de0af6f7 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.692079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62e3cb-8090-442b-842e-0940de0af6f7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.692079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62e3cb-8090-442b-842e-0940de0af6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.692369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158635a6-de26-4236-a7ec-bae92a0138c1 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:20.692454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ad62e3cb-8090-442b-842e-0940de0af6f7 None None] MFA Rules not processed for user `b4664710493b462bafae3908c582e9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:20.692454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ad62e3cb-8090-442b-842e-0940de0af6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:20.766081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 840/1718] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 21:56:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:20.767014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62e3cb-8090-442b-842e-0940de0af6f7 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:20.780153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158635a6-de26-4236-a7ec-bae92a0138c1 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:20.783231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62e3cb-8090-442b-842e-0940de0af6f7 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:20.789179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b7313-8935-41a5-8140-0169cba8c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:20.789675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55528754-768c-4d02-8bd8-a46d93109e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:20.790115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b7313-8935-41a5-8140-0169cba8c26b admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.790475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55528754-768c-4d02-8bd8-a46d93109e81 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.790568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b7313-8935-41a5-8140-0169cba8c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.790700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b7313-8935-41a5-8140-0169cba8c26b admin admin] PATH_INFO: `/v3/projects/80899ca824c8421180d47be89be427ad/users/8ea3ce8ac9904ab39632bea80cebe2b1/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.790842 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55528754-768c-4d02-8bd8-a46d93109e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.791085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55528754-768c-4d02-8bd8-a46d93109e81 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.791955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55528754-768c-4d02-8bd8-a46d93109e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:20.794852 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55528754-768c-4d02-8bd8-a46d93109e81 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:20.795006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b7313-8935-41a5-8140-0169cba8c26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=80899ca824c8421180d47be89be427ad, user_id=8ea3ce8ac9904ab39632bea80cebe2b1, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:20.797777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b7313-8935-41a5-8140-0169cba8c26b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:20.810600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 879/1719] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:20 2022] PUT /identity/v3/projects/80899ca824c8421180d47be89be427ad/users/8ea3ce8ac9904ab39632bea80cebe2b1/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:20.811574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b7313-8935-41a5-8140-0169cba8c26b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:20.820347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-248b7313-8935-41a5-8140-0169cba8c26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:20.890061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b7313-8935-41a5-8140-0169cba8c26b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:20.900860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969452aa-fe67-434a-9168-bdb7a0adb4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:20.901523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969452aa-fe67-434a-9168-bdb7a0adb4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.901802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969452aa-fe67-434a-9168-bdb7a0adb4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.902113 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969452aa-fe67-434a-9168-bdb7a0adb4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.910292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969452aa-fe67-434a-9168-bdb7a0adb4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:20.916787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969452aa-fe67-434a-9168-bdb7a0adb4b7 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:20.920830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 880/1720] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:20.922140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a87b7-0831-43d7-9c60-70fa7113646a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:20.922425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a87b7-0831-43d7-9c60-70fa7113646a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:20.922701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a87b7-0831-43d7-9c60-70fa7113646a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:20.948402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 841/1721] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:20 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:20.952589 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55528754-768c-4d02-8bd8-a46d93109e81 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:20.972254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55528754-768c-4d02-8bd8-a46d93109e81 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:20.983196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-eb8a87b7-0831-43d7-9c60-70fa7113646a None None] MFA Rules not processed for user `8ea3ce8ac9904ab39632bea80cebe2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:20.984544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-eb8a87b7-0831-43d7-9c60-70fa7113646a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:21.070332 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca191ea-14fc-41f1-99b2-9bea7eb77afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:21.071218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca191ea-14fc-41f1-99b2-9bea7eb77afd admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:21.071619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca191ea-14fc-41f1-99b2-9bea7eb77afd admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:21.072000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca191ea-14fc-41f1-99b2-9bea7eb77afd admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:21.073677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca191ea-14fc-41f1-99b2-9bea7eb77afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:21.076415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca191ea-14fc-41f1-99b2-9bea7eb77afd admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:21.104422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 842/1722] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:21.107018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca191ea-14fc-41f1-99b2-9bea7eb77afd admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:21.122623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca191ea-14fc-41f1-99b2-9bea7eb77afd admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:21.123177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 881/1723] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:21.135574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a87b7-0831-43d7-9c60-70fa7113646a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:21.137103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-eb8a87b7-0831-43d7-9c60-70fa7113646a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:21.141026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159567b-a06b-4e9b-9c02-746e0947fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:21.142094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159567b-a06b-4e9b-9c02-746e0947fa18 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:21.142538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159567b-a06b-4e9b-9c02-746e0947fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:21.142966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159567b-a06b-4e9b-9c02-746e0947fa18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:21.143854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159567b-a06b-4e9b-9c02-746e0947fa18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:21.145525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159567b-a06b-4e9b-9c02-746e0947fa18 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:21.168858 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 843/1724] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:21.169824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159567b-a06b-4e9b-9c02-746e0947fa18 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:21.229633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159567b-a06b-4e9b-9c02-746e0947fa18 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:21.246336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d13ae3-6492-417d-9461-f02bcb2f9093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:21.246943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d13ae3-6492-417d-9461-f02bcb2f9093 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:21.247248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d13ae3-6492-417d-9461-f02bcb2f9093 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:21.258631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d13ae3-6492-417d-9461-f02bcb2f9093 admin admin] PATH_INFO: `/v3/projects/c2ec9abd2e10484596050d74ae09e22b/users/8e518d265f6c448c9e9817044e84b9c6/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:21.263713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a87b7-0831-43d7-9c60-70fa7113646a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:21.269108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047f1e0-8cd1-44ca-8b03-47a0cc27ec93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:21.269816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047f1e0-8cd1-44ca-8b03-47a0cc27ec93 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:21.270143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047f1e0-8cd1-44ca-8b03-47a0cc27ec93 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:21.270431 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047f1e0-8cd1-44ca-8b03-47a0cc27ec93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:21.283769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047f1e0-8cd1-44ca-8b03-47a0cc27ec93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:21.285945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047f1e0-8cd1-44ca-8b03-47a0cc27ec93 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:21.297922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d13ae3-6492-417d-9461-f02bcb2f9093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ec9abd2e10484596050d74ae09e22b, user_id=8e518d265f6c448c9e9817044e84b9c6, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:21.299469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 882/1725] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:56:21.300386 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d13ae3-6492-417d-9461-f02bcb2f9093 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:21.394030 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 844/1726] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:21 2022] PUT /identity/v3/projects/c2ec9abd2e10484596050d74ae09e22b/users/8e518d265f6c448c9e9817044e84b9c6/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:21.402388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cc25f-8ed6-4ba4-a86b-13cb18de10a3 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:21.403807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cc25f-8ed6-4ba4-a86b-13cb18de10a3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:21.404201 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cc25f-8ed6-4ba4-a86b-13cb18de10a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:21.438196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d13ae3-6492-417d-9461-f02bcb2f9093 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:21.464544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-651cc25f-8ed6-4ba4-a86b-13cb18de10a3 None None] MFA Rules not processed for user `8e518d265f6c448c9e9817044e84b9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:21.466322 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-651cc25f-8ed6-4ba4-a86b-13cb18de10a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:21.534615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d13ae3-6492-417d-9461-f02bcb2f9093 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:21.539547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:21.540416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:21.540697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:21.540973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] PATH_INFO: `/v3/users/cceca27349a5443c857583fdaeeb8fc8` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:21.542332 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cceca27349a5443c857583fdaeeb8fc8)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:21.544333 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:21.544935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 883/1727] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:21.556391 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cc25f-8ed6-4ba4-a86b-13cb18de10a3 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:21.558060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-651cc25f-8ed6-4ba4-a86b-13cb18de10a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:21.638772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cc25f-8ed6-4ba4-a86b-13cb18de10a3 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:21.646197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966d199-df07-4210-9783-3de3888424ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:21.646883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966d199-df07-4210-9783-3de3888424ce service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:21.647166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966d199-df07-4210-9783-3de3888424ce service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:21.647443 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966d199-df07-4210-9783-3de3888424ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:21.658643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966d199-df07-4210-9783-3de3888424ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:21.671847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966d199-df07-4210-9783-3de3888424ce service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:21.682245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 884/1728] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:21.805801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cceca27349a5443c857583fdaeeb8fc8'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:21.806780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cceca27349a5443c857583fdaeeb8fc8'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:21.916227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cceca27349a5443c857583fdaeeb8fc8'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:21.923318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cceca27349a5443c857583fdaeeb8fc8'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:21.935879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cceca27349a5443c857583fdaeeb8fc8'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:21.942484 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 845/1729] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:21 2022] DELETE /identity/v3/users/cceca27349a5443c857583fdaeeb8fc8 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:21.949860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236b6da-3d16-47c6-be17-423878ba4085 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:21.949860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236b6da-3d16-47c6-be17-423878ba4085 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:21.949860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236b6da-3d16-47c6-be17-423878ba4085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:21.965375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-a236b6da-3d16-47c6-be17-423878ba4085 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:21.966556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a236b6da-3d16-47c6-be17-423878ba4085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:22.023519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 885/1730] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:22.033065 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:22.034626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:22.094000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ca9a7-b5f7-408f-bece-3b837ff15976 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:22.100012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af226-6bd5-42a1-94cc-2f97d3240fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:22.100820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af226-6bd5-42a1-94cc-2f97d3240fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:22.101224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af226-6bd5-42a1-94cc-2f97d3240fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:22.101600 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af226-6bd5-42a1-94cc-2f97d3240fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:22.112171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9af226-6bd5-42a1-94cc-2f97d3240fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:22.114895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9af226-6bd5-42a1-94cc-2f97d3240fc3 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:22.127597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 846/1731] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:22.749463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236b6da-3d16-47c6-be17-423878ba4085 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:22.751092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a236b6da-3d16-47c6-be17-423878ba4085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:22.770686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236b6da-3d16-47c6-be17-423878ba4085 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:22.777713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:22.777713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:22.777713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:22.777952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] PATH_INFO: `/v3/projects/c1352a60cbc142b3b9192e80ca1dbe31` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:22.779531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1352a60cbc142b3b9192e80ca1dbe31)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:22.781749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:22.927206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1352a60cbc142b3b9192e80ca1dbe31', 'request_id': 'req-a9cd22a9-7626-4a43-acba-0948c4acfb1e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:22.934340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1352a60cbc142b3b9192e80ca1dbe31', 'request_id': 'req-a9cd22a9-7626-4a43-acba-0948c4acfb1e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:23.379714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1352a60cbc142b3b9192e80ca1dbe31', 'request_id': 'req-a9cd22a9-7626-4a43-acba-0948c4acfb1e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:23.390316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] The token cache is being invalidate because project c1352a60cbc142b3b9192e80ca1dbe31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:23.390612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:23.391238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:23.392784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 886/1732] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:22 2022] DELETE /identity/v3/projects/c1352a60cbc142b3b9192e80ca1dbe31 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:23.397255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af226-6bd5-42a1-94cc-2f97d3240fc3 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:23.406805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af226-6bd5-42a1-94cc-2f97d3240fc3 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:23.463011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:23.464165 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:23.464443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:23.464717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] PATH_INFO: `/v3/users/8ea3ce8ac9904ab39632bea80cebe2b1` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:23.465920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea3ce8ac9904ab39632bea80cebe2b1)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:23.467867 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:23.680443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea3ce8ac9904ab39632bea80cebe2b1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:23.681282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea3ce8ac9904ab39632bea80cebe2b1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:23.740586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea3ce8ac9904ab39632bea80cebe2b1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:23.748405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea3ce8ac9904ab39632bea80cebe2b1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:23.761389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2daa63c-97e5-4362-8c2d-ec0808a31c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea3ce8ac9904ab39632bea80cebe2b1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:23.768315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 847/1733] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:23 2022] DELETE /identity/v3/users/8ea3ce8ac9904ab39632bea80cebe2b1 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:24.293707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:24.293707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:24.313722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd22a9-7626-4a43-acba-0948c4acfb1e admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:24.393326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:24.394459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:24.394810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:24.395339 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] PATH_INFO: `/v3/projects/80899ca824c8421180d47be89be427ad` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:24.396770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80899ca824c8421180d47be89be427ad)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:24.398771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:24.599111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80899ca824c8421180d47be89be427ad', 'request_id': 'req-bf2995da-d671-4b39-84bd-4d2591cff610'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:24.605786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80899ca824c8421180d47be89be427ad', 'request_id': 'req-bf2995da-d671-4b39-84bd-4d2591cff610'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:24.676676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80899ca824c8421180d47be89be427ad', 'request_id': 'req-bf2995da-d671-4b39-84bd-4d2591cff610'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:24.687635 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] The token cache is being invalidate because project 80899ca824c8421180d47be89be427ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:24.687872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:24.688625 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-bf2995da-d671-4b39-84bd-4d2591cff610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:24.690551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 887/1734] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:24 2022] DELETE /identity/v3/projects/80899ca824c8421180d47be89be427ad => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:24.697595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f828d8-7999-4df7-aa86-ab320b7b534a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:24.711382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f828d8-7999-4df7-aa86-ab320b7b534a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:24.711382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f828d8-7999-4df7-aa86-ab320b7b534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:24.718963 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-27f828d8-7999-4df7-aa86-ab320b7b534a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:24.720196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-27f828d8-7999-4df7-aa86-ab320b7b534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:24.780373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 848/1735] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:24.789298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea938c5c-a3da-4eb6-8fad-31e035d64bde None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:24.789584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea938c5c-a3da-4eb6-8fad-31e035d64bde None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:24.789856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea938c5c-a3da-4eb6-8fad-31e035d64bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:24.809615 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ea938c5c-a3da-4eb6-8fad-31e035d64bde None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:24.810780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ea938c5c-a3da-4eb6-8fad-31e035d64bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:24.819639 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 888/1736] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:24.824716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f828d8-7999-4df7-aa86-ab320b7b534a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:24.835058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f828d8-7999-4df7-aa86-ab320b7b534a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:24.839965 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a63ba-c062-42f2-b855-df61b3c076eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:24.840626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a63ba-c062-42f2-b855-df61b3c076eb admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:24.840895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a63ba-c062-42f2-b855-df61b3c076eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:24.841192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a63ba-c062-42f2-b855-df61b3c076eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:24.841906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a63ba-c062-42f2-b855-df61b3c076eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:24.842245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a63ba-c062-42f2-b855-df61b3c076eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:24.843905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a63ba-c062-42f2-b855-df61b3c076eb admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:24.856428 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 849/1737] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:56:24.860958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea938c5c-a3da-4eb6-8fad-31e035d64bde None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:24.870628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea938c5c-a3da-4eb6-8fad-31e035d64bde None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:24.875685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484225ed-2952-496a-9ed2-42edacb23c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:24.885433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484225ed-2952-496a-9ed2-42edacb23c38 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:24.885433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484225ed-2952-496a-9ed2-42edacb23c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:24.885433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484225ed-2952-496a-9ed2-42edacb23c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:24.885433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484225ed-2952-496a-9ed2-42edacb23c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:24.885433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484225ed-2952-496a-9ed2-42edacb23c38 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:25.175594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 889/1738] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:24 2022] POST /identity/v3/projects => generated 401 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:25.180439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a63ba-c062-42f2-b855-df61b3c076eb admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:25.190336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a63ba-c062-42f2-b855-df61b3c076eb admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:25.244068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76edd04-8b52-4e1c-8d7f-7395aa59d6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:25.244731 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76edd04-8b52-4e1c-8d7f-7395aa59d6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:25.245009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76edd04-8b52-4e1c-8d7f-7395aa59d6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:25.245290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76edd04-8b52-4e1c-8d7f-7395aa59d6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:25.245961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76edd04-8b52-4e1c-8d7f-7395aa59d6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:25.247913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76edd04-8b52-4e1c-8d7f-7395aa59d6d5 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:25.384744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 850/1739] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:25 2022] POST /identity/v3/users => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:25.391606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484225ed-2952-496a-9ed2-42edacb23c38 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:25.399330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484225ed-2952-496a-9ed2-42edacb23c38 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:25.403824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30267d-c31b-48c8-bb5c-8a74a66d2d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:25.404469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30267d-c31b-48c8-bb5c-8a74a66d2d5b admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:25.404746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30267d-c31b-48c8-bb5c-8a74a66d2d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:25.405015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30267d-c31b-48c8-bb5c-8a74a66d2d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:25.405728 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30267d-c31b-48c8-bb5c-8a74a66d2d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:25.407370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30267d-c31b-48c8-bb5c-8a74a66d2d5b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:25.417950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 890/1740] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:25.421816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76edd04-8b52-4e1c-8d7f-7395aa59d6d5 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:25.431805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76edd04-8b52-4e1c-8d7f-7395aa59d6d5 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:25.436380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ada2e-6030-4709-9669-abfdce12b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:25.437027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ada2e-6030-4709-9669-abfdce12b643 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:25.437307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ada2e-6030-4709-9669-abfdce12b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:25.437579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ada2e-6030-4709-9669-abfdce12b643 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:25.438328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ada2e-6030-4709-9669-abfdce12b643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:25.439898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ada2e-6030-4709-9669-abfdce12b643 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:25.449963 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 851/1741] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:25.453763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30267d-c31b-48c8-bb5c-8a74a66d2d5b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:25.464383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30267d-c31b-48c8-bb5c-8a74a66d2d5b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:25.470618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26635d0b-eaed-4796-8e50-ec8f3fbcacfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:25.471507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26635d0b-eaed-4796-8e50-ec8f3fbcacfd admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:25.471782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26635d0b-eaed-4796-8e50-ec8f3fbcacfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:25.472052 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26635d0b-eaed-4796-8e50-ec8f3fbcacfd admin admin] PATH_INFO: `/v3/projects/40c8c409e0ed4007b1840cde401cfa8d/users/d386bdfd6c8041108481554056fe7291/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:25.487985 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26635d0b-eaed-4796-8e50-ec8f3fbcacfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c8c409e0ed4007b1840cde401cfa8d, user_id=d386bdfd6c8041108481554056fe7291, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:25.490750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26635d0b-eaed-4796-8e50-ec8f3fbcacfd admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:25.573918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 891/1742] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:25 2022] PUT /identity/v3/projects/40c8c409e0ed4007b1840cde401cfa8d/users/d386bdfd6c8041108481554056fe7291/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:25.584367 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b193-3447-43c6-b842-8825f96d99ec None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:25.588245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b193-3447-43c6-b842-8825f96d99ec None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:25.588245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b193-3447-43c6-b842-8825f96d99ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:25.611284 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-0689b193-3447-43c6-b842-8825f96d99ec None None] MFA Rules not processed for user `d386bdfd6c8041108481554056fe7291`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:25.612417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0689b193-3447-43c6-b842-8825f96d99ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:25.690490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 852/1743] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:25.696607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26635d0b-eaed-4796-8e50-ec8f3fbcacfd admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:25.763330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26635d0b-eaed-4796-8e50-ec8f3fbcacfd admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:25.768965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044a63b-fcbe-4277-964f-585885028022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:25.769588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044a63b-fcbe-4277-964f-585885028022 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:25.770176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044a63b-fcbe-4277-964f-585885028022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:25.770526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044a63b-fcbe-4277-964f-585885028022 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:25.771234 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044a63b-fcbe-4277-964f-585885028022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:25.773166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044a63b-fcbe-4277-964f-585885028022 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:25.912462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 892/1744] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:25 2022] POST /identity/v3/projects => generated 399 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:25.916718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b193-3447-43c6-b842-8825f96d99ec None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:25.928358 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b193-3447-43c6-b842-8825f96d99ec None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:25.991741 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cbc79-8518-4b2c-adf0-908418342d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:25.992424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cbc79-8518-4b2c-adf0-908418342d4f admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:25.992712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cbc79-8518-4b2c-adf0-908418342d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:25.992983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cbc79-8518-4b2c-adf0-908418342d4f admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:25.993674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cbc79-8518-4b2c-adf0-908418342d4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:25.995672 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cbc79-8518-4b2c-adf0-908418342d4f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:26.146167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 853/1745] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:25 2022] POST /identity/v3/users => generated 306 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:26.150813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044a63b-fcbe-4277-964f-585885028022 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:26.171395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044a63b-fcbe-4277-964f-585885028022 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:26.182872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ebdcd-3d6e-4ecd-8b0f-f9c072624b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:26.183662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ebdcd-3d6e-4ecd-8b0f-f9c072624b48 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:26.183943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ebdcd-3d6e-4ecd-8b0f-f9c072624b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:26.184281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ebdcd-3d6e-4ecd-8b0f-f9c072624b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:26.185013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ebdcd-3d6e-4ecd-8b0f-f9c072624b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:26.186812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ebdcd-3d6e-4ecd-8b0f-f9c072624b48 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:26.204358 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 893/1746] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:26.209930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cbc79-8518-4b2c-adf0-908418342d4f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:26.221734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cbc79-8518-4b2c-adf0-908418342d4f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:26.228611 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b5c60-e5b4-461d-8600-9a1e44802e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:26.229521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b5c60-e5b4-461d-8600-9a1e44802e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:26.229806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b5c60-e5b4-461d-8600-9a1e44802e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:26.230103 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b5c60-e5b4-461d-8600-9a1e44802e24 admin admin] PATH_INFO: `/v3/projects/6dd4dfe39c8c4fedb0050725c7ed5c00/users/77c6b98b83f945a6919ad91ad01bcaff/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:26.248437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b5c60-e5b4-461d-8600-9a1e44802e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd4dfe39c8c4fedb0050725c7ed5c00, user_id=77c6b98b83f945a6919ad91ad01bcaff, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:26.251226 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b5c60-e5b4-461d-8600-9a1e44802e24 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:26.334258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 854/1747] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:26 2022] PUT /identity/v3/projects/6dd4dfe39c8c4fedb0050725c7ed5c00/users/77c6b98b83f945a6919ad91ad01bcaff/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:26.340038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ebdcd-3d6e-4ecd-8b0f-f9c072624b48 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:26.351168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ebdcd-3d6e-4ecd-8b0f-f9c072624b48 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:26.415360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b9e68-ab22-4c10-8e42-f63abd225e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:26.416839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b9e68-ab22-4c10-8e42-f63abd225e31 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:26.417438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b9e68-ab22-4c10-8e42-f63abd225e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:26.418055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b9e68-ab22-4c10-8e42-f63abd225e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:26.422663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b9e68-ab22-4c10-8e42-f63abd225e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:26.424441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b9e68-ab22-4c10-8e42-f63abd225e31 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:26.435355 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 894/1748] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:26.439644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b5c60-e5b4-461d-8600-9a1e44802e24 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:26.450587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b5c60-e5b4-461d-8600-9a1e44802e24 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:26.455788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07c7da-439d-4cc4-91c8-e8700f1a6422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:26.456699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07c7da-439d-4cc4-91c8-e8700f1a6422 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:26.456969 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07c7da-439d-4cc4-91c8-e8700f1a6422 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:26.458047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07c7da-439d-4cc4-91c8-e8700f1a6422 admin admin] PATH_INFO: `/v3/projects/6dd4dfe39c8c4fedb0050725c7ed5c00/users/77c6b98b83f945a6919ad91ad01bcaff/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:26.460215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07c7da-439d-4cc4-91c8-e8700f1a6422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd4dfe39c8c4fedb0050725c7ed5c00, user_id=77c6b98b83f945a6919ad91ad01bcaff, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:26.462887 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07c7da-439d-4cc4-91c8-e8700f1a6422 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:26.474518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 855/1749] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:26 2022] PUT /identity/v3/projects/6dd4dfe39c8c4fedb0050725c7ed5c00/users/77c6b98b83f945a6919ad91ad01bcaff/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:26.484769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32a6a7-8261-4fd7-8482-d122899f82ef None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:26.485153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32a6a7-8261-4fd7-8482-d122899f82ef None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:26.485432 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32a6a7-8261-4fd7-8482-d122899f82ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:26.513032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-9a32a6a7-8261-4fd7-8482-d122899f82ef None None] MFA Rules not processed for user `77c6b98b83f945a6919ad91ad01bcaff`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:26.514292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9a32a6a7-8261-4fd7-8482-d122899f82ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:26.585230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 895/1750] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:26.599975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07c7da-439d-4cc4-91c8-e8700f1a6422 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:26.602359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7d07c7da-439d-4cc4-91c8-e8700f1a6422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:26.701819 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07c7da-439d-4cc4-91c8-e8700f1a6422 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:26.705538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa226-11d6-401a-b51a-19c7db5d63f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:26.706234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa226-11d6-401a-b51a-19c7db5d63f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:26.706507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa226-11d6-401a-b51a-19c7db5d63f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:26.706781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affa226-11d6-401a-b51a-19c7db5d63f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:26.717950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affa226-11d6-401a-b51a-19c7db5d63f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:26.719664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affa226-11d6-401a-b51a-19c7db5d63f6 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:26.730709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 856/1751] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:26 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:26.956854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32a6a7-8261-4fd7-8482-d122899f82ef None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:26.958663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9a32a6a7-8261-4fd7-8482-d122899f82ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:26.973945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32a6a7-8261-4fd7-8482-d122899f82ef None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:26.981074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f80c7-f00c-4ba7-b3aa-951e42cbad9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:26.981861 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f80c7-f00c-4ba7-b3aa-951e42cbad9a service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:26.982210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f80c7-f00c-4ba7-b3aa-951e42cbad9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:26.982489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f80c7-f00c-4ba7-b3aa-951e42cbad9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:27.047294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f80c7-f00c-4ba7-b3aa-951e42cbad9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:27.048739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f80c7-f00c-4ba7-b3aa-951e42cbad9a service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:27.059515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 896/1752] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:29.778801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa226-11d6-401a-b51a-19c7db5d63f6 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:29.780268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9affa226-11d6-401a-b51a-19c7db5d63f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:29.844547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affa226-11d6-401a-b51a-19c7db5d63f6 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:29.849351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:29.850260 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:29.850539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:29.850815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] PATH_INFO: `/v3/users/8e518d265f6c448c9e9817044e84b9c6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:29.852100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e518d265f6c448c9e9817044e84b9c6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:29.854192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:30.105232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e518d265f6c448c9e9817044e84b9c6'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:30.105892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e518d265f6c448c9e9817044e84b9c6'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:30.247565 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e518d265f6c448c9e9817044e84b9c6'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:30.255771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e518d265f6c448c9e9817044e84b9c6'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:30.268310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e518d265f6c448c9e9817044e84b9c6'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:30.276047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 857/1753] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:29 2022] DELETE /identity/v3/users/8e518d265f6c448c9e9817044e84b9c6 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:30.282162 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d8720-32ec-4866-834e-414bc387cb81 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:30.282695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d8720-32ec-4866-834e-414bc387cb81 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:30.282784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d8720-32ec-4866-834e-414bc387cb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:30.299754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-670d8720-32ec-4866-834e-414bc387cb81 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:30.305331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-670d8720-32ec-4866-834e-414bc387cb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:30.367783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 897/1754] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:30.377624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:30.379720 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:30.437129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb666b-233f-4a58-94a0-6114899485a2 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:30.443461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7558b-c6b4-4c46-b70d-142c637e2c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:30.451153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7558b-c6b4-4c46-b70d-142c637e2c82 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:30.451153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7558b-c6b4-4c46-b70d-142c637e2c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:30.451153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7558b-c6b4-4c46-b70d-142c637e2c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:30.454744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7558b-c6b4-4c46-b70d-142c637e2c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:30.456199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7558b-c6b4-4c46-b70d-142c637e2c82 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:30.486759 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 858/1755] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:30.495905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3ae4-83a5-4cd4-b06b-398e7a4c7038 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:30.496357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3ae4-83a5-4cd4-b06b-398e7a4c7038 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:30.496765 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d3ae4-83a5-4cd4-b06b-398e7a4c7038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:30.516819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-1c3d3ae4-83a5-4cd4-b06b-398e7a4c7038 None None] MFA Rules not processed for user `b4664710493b462bafae3908c582e9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:30.518038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1c3d3ae4-83a5-4cd4-b06b-398e7a4c7038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:30.526373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 898/1756] 10.222.0.16 () {58 vars in 1015 bytes} [Mon Feb 28 21:56:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:30.548070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7558b-c6b4-4c46-b70d-142c637e2c82 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:30.549675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-63b7558b-c6b4-4c46-b70d-142c637e2c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:30.569195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7558b-c6b4-4c46-b70d-142c637e2c82 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:30.575629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8426-51a8-43fd-8438-3fe97cdc4812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:30.576283 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8426-51a8-43fd-8438-3fe97cdc4812 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:30.576567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8426-51a8-43fd-8438-3fe97cdc4812 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:30.576838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f8426-51a8-43fd-8438-3fe97cdc4812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:30.578882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d3ae4-83a5-4cd4-b06b-398e7a4c7038 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:30.585796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f8426-51a8-43fd-8438-3fe97cdc4812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:30.587538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f8426-51a8-43fd-8438-3fe97cdc4812 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:30.590882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d3ae4-83a5-4cd4-b06b-398e7a4c7038 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:30.600665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 859/1757] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:30.601584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27d5c-b24b-47a1-82a0-e28c56bf2c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:30.605901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27d5c-b24b-47a1-82a0-e28c56bf2c06 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:30.605901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27d5c-b24b-47a1-82a0-e28c56bf2c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:30.605901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27d5c-b24b-47a1-82a0-e28c56bf2c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:30.624657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27d5c-b24b-47a1-82a0-e28c56bf2c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:30.629902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27d5c-b24b-47a1-82a0-e28c56bf2c06 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:30.642899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 899/1758] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:30.700370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8426-51a8-43fd-8438-3fe97cdc4812 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:30.700370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9f3f8426-51a8-43fd-8438-3fe97cdc4812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:30.721647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f8426-51a8-43fd-8438-3fe97cdc4812 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:30.732942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:30.734239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:30.734701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:30.735197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] PATH_INFO: `/v3/users/979dc554b28140ed85fee864c0a785c0` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:30.737903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=979dc554b28140ed85fee864c0a785c0)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:30.740737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:31.021927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979dc554b28140ed85fee864c0a785c0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:31.022950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979dc554b28140ed85fee864c0a785c0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:31.128566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979dc554b28140ed85fee864c0a785c0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:31.136867 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979dc554b28140ed85fee864c0a785c0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:31.151621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979dc554b28140ed85fee864c0a785c0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:31.160699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 860/1759] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:30 2022] DELETE /identity/v3/users/979dc554b28140ed85fee864c0a785c0 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:31.165538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63769329-bff9-4591-978b-cb8efc8f7a4e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:31.165824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63769329-bff9-4591-978b-cb8efc8f7a4e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:31.166281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63769329-bff9-4591-978b-cb8efc8f7a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:31.194428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-63769329-bff9-4591-978b-cb8efc8f7a4e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:31.195560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-63769329-bff9-4591-978b-cb8efc8f7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:31.330527 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 900/1760] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:31.346966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:31.349033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:31.449158 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b3bcc-911b-4b73-ab62-5bf42e8944d0 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:31.454129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0e3c7-37f4-47ce-ac46-c140b8c76d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:31.458083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0e3c7-37f4-47ce-ac46-c140b8c76d4e service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:31.458083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0e3c7-37f4-47ce-ac46-c140b8c76d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:31.458083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0e3c7-37f4-47ce-ac46-c140b8c76d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:31.470853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0e3c7-37f4-47ce-ac46-c140b8c76d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:31.472710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0e3c7-37f4-47ce-ac46-c140b8c76d4e service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:31.492107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 861/1761] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:31.609718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63769329-bff9-4591-978b-cb8efc8f7a4e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:31.611386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-63769329-bff9-4591-978b-cb8efc8f7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:31.633869 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63769329-bff9-4591-978b-cb8efc8f7a4e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:31.642756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:31.643631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:31.644085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:31.644564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] PATH_INFO: `/v3/projects/c2ec9abd2e10484596050d74ae09e22b` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:31.646808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ec9abd2e10484596050d74ae09e22b)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:31.649756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:31.799154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ec9abd2e10484596050d74ae09e22b', 'request_id': 'req-f23e0dd6-c9fc-4951-9213-986c7c4dae77'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:31.818353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ec9abd2e10484596050d74ae09e22b', 'request_id': 'req-f23e0dd6-c9fc-4951-9213-986c7c4dae77'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:31.933491 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ec9abd2e10484596050d74ae09e22b', 'request_id': 'req-f23e0dd6-c9fc-4951-9213-986c7c4dae77'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:31.947386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] The token cache is being invalidate because project c2ec9abd2e10484596050d74ae09e22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:31.947842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:31.948697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f23e0dd6-c9fc-4951-9213-986c7c4dae77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:31.951439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 901/1762] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:31 2022] DELETE /identity/v3/projects/c2ec9abd2e10484596050d74ae09e22b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:31.956241 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec5b98-9f5c-4f56-87e0-0c6daa42ffc4 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:31.956715 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec5b98-9f5c-4f56-87e0-0c6daa42ffc4 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:31.957702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec5b98-9f5c-4f56-87e0-0c6daa42ffc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:31.982192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-fcec5b98-9f5c-4f56-87e0-0c6daa42ffc4 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:31.982192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fcec5b98-9f5c-4f56-87e0-0c6daa42ffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:32.065486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 862/1763] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:32.073559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1675-cece-4d74-b78c-9ea518938847 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.076092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1675-cece-4d74-b78c-9ea518938847 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.076092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd1675-cece-4d74-b78c-9ea518938847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.097682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-5fcd1675-cece-4d74-b78c-9ea518938847 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:32.100262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5fcd1675-cece-4d74-b78c-9ea518938847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:32.117848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 902/1764] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:32.122609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec5b98-9f5c-4f56-87e0-0c6daa42ffc4 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:32.137865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec5b98-9f5c-4f56-87e0-0c6daa42ffc4 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:32.143756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef293e3-ce29-4a3d-8ade-67af34d35082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:32.145255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef293e3-ce29-4a3d-8ade-67af34d35082 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.145671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef293e3-ce29-4a3d-8ade-67af34d35082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.146085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef293e3-ce29-4a3d-8ade-67af34d35082 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.146997 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef293e3-ce29-4a3d-8ade-67af34d35082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:32.147566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef293e3-ce29-4a3d-8ade-67af34d35082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:32.150123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef293e3-ce29-4a3d-8ade-67af34d35082 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:32.174592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 863/1765] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:56:32.176303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1675-cece-4d74-b78c-9ea518938847 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:32.188924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd1675-cece-4d74-b78c-9ea518938847 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:32.197572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a83fda-1d31-4a5e-a216-072470020503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:32.198499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a83fda-1d31-4a5e-a216-072470020503 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.199006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a83fda-1d31-4a5e-a216-072470020503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.201963 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a83fda-1d31-4a5e-a216-072470020503 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.201963 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a83fda-1d31-4a5e-a216-072470020503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:32.203535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a83fda-1d31-4a5e-a216-072470020503 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:32.222200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d80bd9-0bb6-44bc-8a06-1ba628223e57 None None] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.223909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d80bd9-0bb6-44bc-8a06-1ba628223e57 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.224394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d80bd9-0bb6-44bc-8a06-1ba628223e57 None None] PATH_INFO: `/` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.226860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 864/1766] 10.222.0.26 () {54 vars in 921 bytes} [Mon Feb 28 21:56:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 21:56:32.303825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614314e-1e29-460c-b15d-9f7bf164735d None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.309212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614314e-1e29-460c-b15d-9f7bf164735d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.309212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614314e-1e29-460c-b15d-9f7bf164735d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.342844 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f614314e-1e29-460c-b15d-9f7bf164735d None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:32.344809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f614314e-1e29-460c-b15d-9f7bf164735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:32.381449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 903/1767] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:32 2022] POST /identity/v3/projects => generated 363 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:32.387409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a83fda-1d31-4a5e-a216-072470020503 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:32.497797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 865/1768] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Feb 28 21:56:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:32.533231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614314e-1e29-460c-b15d-9f7bf164735d None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:32.534727 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f614314e-1e29-460c-b15d-9f7bf164735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:32.584901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a83fda-1d31-4a5e-a216-072470020503 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:32.585302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614314e-1e29-460c-b15d-9f7bf164735d None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:32.585387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4fa04-72ae-439a-aa62-64c01a72e7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:32.585387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4fa04-72ae-439a-aa62-64c01a72e7ef admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.585387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4fa04-72ae-439a-aa62-64c01a72e7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.585387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4fa04-72ae-439a-aa62-64c01a72e7ef admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.585761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4fa04-72ae-439a-aa62-64c01a72e7ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:32.585761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4fa04-72ae-439a-aa62-64c01a72e7ef admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:32.659848 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccd200-90f0-4391-800a-51ecee80a0be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:32.660962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccd200-90f0-4391-800a-51ecee80a0be service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.661498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccd200-90f0-4391-800a-51ecee80a0be service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.661877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beccd200-90f0-4391-800a-51ecee80a0be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.672534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccd200-90f0-4391-800a-51ecee80a0be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:32.674401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beccd200-90f0-4391-800a-51ecee80a0be service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:32.688269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 866/1769] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:32.830947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 904/1770] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:32 2022] POST /identity/v3/users => generated 282 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:32.835559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccd200-90f0-4391-800a-51ecee80a0be service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:32.847475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beccd200-90f0-4391-800a-51ecee80a0be service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:32.858227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444db45-73db-4680-9526-0d9a03a2ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:32.859040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444db45-73db-4680-9526-0d9a03a2ecad admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.859324 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444db45-73db-4680-9526-0d9a03a2ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.860067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444db45-73db-4680-9526-0d9a03a2ecad admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.860473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444db45-73db-4680-9526-0d9a03a2ecad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:32.862365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444db45-73db-4680-9526-0d9a03a2ecad admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:32.875038 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 867/1771] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:32.879881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4fa04-72ae-439a-aa62-64c01a72e7ef admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:32.890083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4fa04-72ae-439a-aa62-64c01a72e7ef admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:32.894925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02accd-6202-40c3-b6be-f6eaf14df23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:32.895761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02accd-6202-40c3-b6be-f6eaf14df23f admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.896043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02accd-6202-40c3-b6be-f6eaf14df23f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.896313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02accd-6202-40c3-b6be-f6eaf14df23f admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.897034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02accd-6202-40c3-b6be-f6eaf14df23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:32.898677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02accd-6202-40c3-b6be-f6eaf14df23f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:32.908871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 905/1772] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:32.916148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444db45-73db-4680-9526-0d9a03a2ecad admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:32.918686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa223b5-4cba-4193-a087-f9bb2d892422 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.919110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa223b5-4cba-4193-a087-f9bb2d892422 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.919455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa223b5-4cba-4193-a087-f9bb2d892422 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.921704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 906/1773] 10.222.0.26 () {54 vars in 921 bytes} [Mon Feb 28 21:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:56:32.927013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444db45-73db-4680-9526-0d9a03a2ecad admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:32.931725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856322c-33f9-479b-9fbb-82a4ab3a4ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:32.932607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856322c-33f9-479b-9fbb-82a4ab3a4ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.932884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856322c-33f9-479b-9fbb-82a4ab3a4ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.933156 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856322c-33f9-479b-9fbb-82a4ab3a4ff3 admin admin] PATH_INFO: `/v3/projects/e851f1c73695479cb679f5eda6d927bb/users/b7579c45cf00499da8e31b342b444566/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.955306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fa5ca-1f33-4158-bb11-0a366ce4df1f None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:32.955880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fa5ca-1f33-4158-bb11-0a366ce4df1f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:32.956378 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fa5ca-1f33-4158-bb11-0a366ce4df1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:32.961121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856322c-33f9-479b-9fbb-82a4ab3a4ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e851f1c73695479cb679f5eda6d927bb, user_id=b7579c45cf00499da8e31b342b444566, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:32.964718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856322c-33f9-479b-9fbb-82a4ab3a4ff3 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:32.984424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-f45fa5ca-1f33-4158-bb11-0a366ce4df1f None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:32.987991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f45fa5ca-1f33-4158-bb11-0a366ce4df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:33.001468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 907/1774] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Feb 28 21:56:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:33.057862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 868/1775] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:32 2022] PUT /identity/v3/projects/e851f1c73695479cb679f5eda6d927bb/users/b7579c45cf00499da8e31b342b444566/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:33.069306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2fb22-288a-4587-9c3d-f42090cd479a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.070162 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2fb22-288a-4587-9c3d-f42090cd479a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.074093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2fb22-288a-4587-9c3d-f42090cd479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:33.088821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856322c-33f9-479b-9fbb-82a4ab3a4ff3 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:33.090859 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b856322c-33f9-479b-9fbb-82a4ab3a4ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:33.117130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0fe2fb22-288a-4587-9c3d-f42090cd479a None None] MFA Rules not processed for user `b7579c45cf00499da8e31b342b444566`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:33.119787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0fe2fb22-288a-4587-9c3d-f42090cd479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:33.168770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856322c-33f9-479b-9fbb-82a4ab3a4ff3 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:33.175669 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:33.176408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.176897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.177316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] PATH_INFO: `/v3/projects/932547f6cb2e41b7b4ce5f9744dd1b28` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:33.179011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] RBAC: Authorizing `identity:delete_project(project_id=932547f6cb2e41b7b4ce5f9744dd1b28)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:33.182039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:33.270784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 908/1776] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:33.273303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2fb22-288a-4587-9c3d-f42090cd479a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:33.286927 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2fb22-288a-4587-9c3d-f42090cd479a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:33.293116 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e27aa-3283-42c2-9dfc-0d7341fe37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:33.293859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e27aa-3283-42c2-9dfc-0d7341fe37f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.294191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e27aa-3283-42c2-9dfc-0d7341fe37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.294461 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e27aa-3283-42c2-9dfc-0d7341fe37f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:33.295174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e27aa-3283-42c2-9dfc-0d7341fe37f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:33.297526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e27aa-3283-42c2-9dfc-0d7341fe37f3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:33.370231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932547f6cb2e41b7b4ce5f9744dd1b28', 'request_id': 'req-4597eb15-ccf4-4911-8f77-fc2aea9a016d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:33.376982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932547f6cb2e41b7b4ce5f9744dd1b28', 'request_id': 'req-4597eb15-ccf4-4911-8f77-fc2aea9a016d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:33.383543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932547f6cb2e41b7b4ce5f9744dd1b28', 'request_id': 'req-4597eb15-ccf4-4911-8f77-fc2aea9a016d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:33.406064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 909/1777] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:33 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:33.406064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e27aa-3283-42c2-9dfc-0d7341fe37f3 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:33.453233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] The token cache is being invalidate because project 932547f6cb2e41b7b4ce5f9744dd1b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:33.453794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:33.454572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:33.456830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 869/1778] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:33 2022] DELETE /identity/v3/projects/932547f6cb2e41b7b4ce5f9744dd1b28 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:33.457983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:33.459975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:33.488300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e27aa-3283-42c2-9dfc-0d7341fe37f3 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:33.495298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0d78f-3395-404f-b5ec-ccf3a5fec7b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:33.495996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0d78f-3395-404f-b5ec-ccf3a5fec7b3 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.496405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0d78f-3395-404f-b5ec-ccf3a5fec7b3 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.497069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0d78f-3395-404f-b5ec-ccf3a5fec7b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:33.501964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-68a0d78f-3395-404f-b5ec-ccf3a5fec7b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:33.518507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0d78f-3395-404f-b5ec-ccf3a5fec7b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:33.521389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0d78f-3395-404f-b5ec-ccf3a5fec7b3 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:33.539588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 910/1779] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:33.541841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68121204-6005-48fb-9b07-dea7440d6d51 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.542240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68121204-6005-48fb-9b07-dea7440d6d51 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.542748 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68121204-6005-48fb-9b07-dea7440d6d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:33.572626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-68121204-6005-48fb-9b07-dea7440d6d51 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:33.576594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-68121204-6005-48fb-9b07-dea7440d6d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:33.593021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597eb15-ccf4-4911-8f77-fc2aea9a016d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:33.727125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 911/1780] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:33.729074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e8cc-4dc2-480e-b860-24fd11d59899 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.729476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e8cc-4dc2-480e-b860-24fd11d59899 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.730935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e8cc-4dc2-480e-b860-24fd11d59899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:33.737307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1f15-f2e4-4c49-99d9-b55b36686abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:33.739822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1f15-f2e4-4c49-99d9-b55b36686abe admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.740431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1f15-f2e4-4c49-99d9-b55b36686abe admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.740932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1f15-f2e4-4c49-99d9-b55b36686abe admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:33.742146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e1f15-f2e4-4c49-99d9-b55b36686abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:33.745662 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e1f15-f2e4-4c49-99d9-b55b36686abe admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:33.755986 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-9fc2e8cc-4dc2-480e-b860-24fd11d59899 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:33.758326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9fc2e8cc-4dc2-480e-b860-24fd11d59899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:33.772456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 912/1781] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:33.773487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e8cc-4dc2-480e-b860-24fd11d59899 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:33.784203 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e8cc-4dc2-480e-b860-24fd11d59899 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:33.794521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93576b1-d977-459e-a051-27c26d1e42e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:33.795342 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93576b1-d977-459e-a051-27c26d1e42e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.795704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93576b1-d977-459e-a051-27c26d1e42e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.796152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93576b1-d977-459e-a051-27c26d1e42e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:33.797065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93576b1-d977-459e-a051-27c26d1e42e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:33.797423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93576b1-d977-459e-a051-27c26d1e42e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:33.799431 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93576b1-d977-459e-a051-27c26d1e42e9 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:33.819143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 913/1782] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:56:33.823673 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93576b1-d977-459e-a051-27c26d1e42e9 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:33.837621 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93576b1-d977-459e-a051-27c26d1e42e9 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:33.844580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af10d73-78c1-486e-86b7-8793e394049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:33.845514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10d73-78c1-486e-86b7-8793e394049e admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.856838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 870/1783] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:33 2022] POST /identity/v3/users => generated 289 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:33.857094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10d73-78c1-486e-86b7-8793e394049e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.857641 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10d73-78c1-486e-86b7-8793e394049e admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:33.861279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af10d73-78c1-486e-86b7-8793e394049e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:33.861279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af10d73-78c1-486e-86b7-8793e394049e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:33.866588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1f15-f2e4-4c49-99d9-b55b36686abe admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:33.887498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e1f15-f2e4-4c49-99d9-b55b36686abe admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:33.903953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef8480-8111-428b-9c9c-20e6d675b292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:33.906733 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef8480-8111-428b-9c9c-20e6d675b292 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.907169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef8480-8111-428b-9c9c-20e6d675b292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.907782 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef8480-8111-428b-9c9c-20e6d675b292 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:33.909266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef8480-8111-428b-9c9c-20e6d675b292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:33.913284 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef8480-8111-428b-9c9c-20e6d675b292 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:33.927587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 871/1784] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:33.932615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef8480-8111-428b-9c9c-20e6d675b292 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:33.961079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef8480-8111-428b-9c9c-20e6d675b292 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:33.975172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe230ce-de69-4965-96f5-3f1a3ef36f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:33.976120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe230ce-de69-4965-96f5-3f1a3ef36f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:33.978200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe230ce-de69-4965-96f5-3f1a3ef36f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:33.978620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe230ce-de69-4965-96f5-3f1a3ef36f97 admin admin] PATH_INFO: `/v3/projects/9ee9444de654400ab1fc89606d7d3794/users/b0d110458b134175838288d47a5d8930/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:34.016067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 914/1785] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:33 2022] POST /identity/v3/projects => generated 405 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:34.019941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe230ce-de69-4965-96f5-3f1a3ef36f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee9444de654400ab1fc89606d7d3794, user_id=b0d110458b134175838288d47a5d8930, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:34.020911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af10d73-78c1-486e-86b7-8793e394049e admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:34.023575 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe230ce-de69-4965-96f5-3f1a3ef36f97 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:34.125949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 872/1786] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:33 2022] PUT /identity/v3/projects/9ee9444de654400ab1fc89606d7d3794/users/b0d110458b134175838288d47a5d8930/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:34.127815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe230ce-de69-4965-96f5-3f1a3ef36f97 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:34.133909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ffe230ce-de69-4965-96f5-3f1a3ef36f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:34.144820 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af10d73-78c1-486e-86b7-8793e394049e admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:34.236297 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b2baa-a08b-402a-b30a-f1faf8f34f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:34.237374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b2baa-a08b-402a-b30a-f1faf8f34f63 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:34.237836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b2baa-a08b-402a-b30a-f1faf8f34f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:34.238439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b2baa-a08b-402a-b30a-f1faf8f34f63 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:34.239519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b2baa-a08b-402a-b30a-f1faf8f34f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:34.242105 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b2baa-a08b-402a-b30a-f1faf8f34f63 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:34.254143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe230ce-de69-4965-96f5-3f1a3ef36f97 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:34.260310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:34.261228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:34.261308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:34.261564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] PATH_INFO: `/v3/users/d386bdfd6c8041108481554056fe7291` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:34.270350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d386bdfd6c8041108481554056fe7291)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:34.270350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:34.374812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 915/1787] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:34 2022] POST /identity/v3/users => generated 303 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:34.376034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b2baa-a08b-402a-b30a-f1faf8f34f63 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:34.386888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b2baa-a08b-402a-b30a-f1faf8f34f63 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:34.393387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32806f-38e1-4957-ab53-6e786c1d8ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:34.394164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32806f-38e1-4957-ab53-6e786c1d8ceb admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:34.404191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32806f-38e1-4957-ab53-6e786c1d8ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:34.404191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32806f-38e1-4957-ab53-6e786c1d8ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:34.404191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32806f-38e1-4957-ab53-6e786c1d8ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:34.404191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32806f-38e1-4957-ab53-6e786c1d8ceb admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:34.415882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 916/1788] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:34.417462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32806f-38e1-4957-ab53-6e786c1d8ceb admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:34.430107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32806f-38e1-4957-ab53-6e786c1d8ceb admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:34.435334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8e6a7-a010-4239-92e1-19b33b635675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:34.436170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e6a7-a010-4239-92e1-19b33b635675 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:34.436448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e6a7-a010-4239-92e1-19b33b635675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:34.436722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8e6a7-a010-4239-92e1-19b33b635675 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:34.437439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8e6a7-a010-4239-92e1-19b33b635675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:34.439035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8e6a7-a010-4239-92e1-19b33b635675 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:34.462292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 917/1789] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:34.463987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8e6a7-a010-4239-92e1-19b33b635675 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:34.476308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8e6a7-a010-4239-92e1-19b33b635675 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:34.489177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef039e8-01d0-4bd3-b4d0-2a4f7161e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:34.494139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef039e8-01d0-4bd3-b4d0-2a4f7161e459 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:34.494139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef039e8-01d0-4bd3-b4d0-2a4f7161e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:34.494139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef039e8-01d0-4bd3-b4d0-2a4f7161e459 admin admin] PATH_INFO: `/v3/projects/9ee9444de654400ab1fc89606d7d3794/users/b0d110458b134175838288d47a5d8930/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:34.496387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef039e8-01d0-4bd3-b4d0-2a4f7161e459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee9444de654400ab1fc89606d7d3794, user_id=b0d110458b134175838288d47a5d8930, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:34.499684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef039e8-01d0-4bd3-b4d0-2a4f7161e459 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:34.500307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd386bdfd6c8041108481554056fe7291'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:34.501033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd386bdfd6c8041108481554056fe7291'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:34.512946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 918/1790] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:34 2022] PUT /identity/v3/projects/9ee9444de654400ab1fc89606d7d3794/users/b0d110458b134175838288d47a5d8930/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:34.513696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef039e8-01d0-4bd3-b4d0-2a4f7161e459 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:34.516048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fef039e8-01d0-4bd3-b4d0-2a4f7161e459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:34.601817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd386bdfd6c8041108481554056fe7291'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:34.610707 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd386bdfd6c8041108481554056fe7291'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:34.615363 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef039e8-01d0-4bd3-b4d0-2a4f7161e459 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:34.622222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:34.624133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:34.624133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:34.624556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] PATH_INFO: `/v3/users/0f1ce4fe5cb14812a86d5f90520e35e5` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:34.626541 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1ce4fe5cb14812a86d5f90520e35e5)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:34.630271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:34.639148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd386bdfd6c8041108481554056fe7291'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:34.648475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 873/1791] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:34 2022] DELETE /identity/v3/users/d386bdfd6c8041108481554056fe7291 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:34.649409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:34.650646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:34.765456 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b99279-83a3-41b8-a10a-5a279f229391 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:34.770838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781e9cd-0fba-4740-8cff-de177de69d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:34.771589 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e9cd-0fba-4740-8cff-de177de69d0b admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:34.771872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e9cd-0fba-4740-8cff-de177de69d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:34.772148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e9cd-0fba-4740-8cff-de177de69d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:34.772942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781e9cd-0fba-4740-8cff-de177de69d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:34.774629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781e9cd-0fba-4740-8cff-de177de69d0b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:34.790180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 874/1792] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:34.792036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aa89f-fe09-448e-aed4-18dcc2cee668 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:34.792271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aa89f-fe09-448e-aed4-18dcc2cee668 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:34.792554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9aa89f-fe09-448e-aed4-18dcc2cee668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:34.843128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-5a9aa89f-fe09-448e-aed4-18dcc2cee668 None None] MFA Rules not processed for user `b0d110458b134175838288d47a5d8930`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:34.844485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5a9aa89f-fe09-448e-aed4-18dcc2cee668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:34.847451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1ce4fe5cb14812a86d5f90520e35e5'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:34.859424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1ce4fe5cb14812a86d5f90520e35e5'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:34.943830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 875/1793] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:34.945178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4691f-0109-4677-a2ec-932dcc602540 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:34.945489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1ce4fe5cb14812a86d5f90520e35e5'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:34.945606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4691f-0109-4677-a2ec-932dcc602540 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:34.946199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4691f-0109-4677-a2ec-932dcc602540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:34.968760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1ce4fe5cb14812a86d5f90520e35e5'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:34.969831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1ce4fe5cb14812a86d5f90520e35e5'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:34.970183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-dae4691f-0109-4677-a2ec-932dcc602540 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:34.971500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dae4691f-0109-4677-a2ec-932dcc602540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:34.978873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 919/1794] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:34 2022] DELETE /identity/v3/users/0f1ce4fe5cb14812a86d5f90520e35e5 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:34.983846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:34.985640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:34.993716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 876/1795] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:34.993716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4691f-0109-4677-a2ec-932dcc602540 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:35.000089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dae4691f-0109-4677-a2ec-932dcc602540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:35.130114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d257f-66f3-48f9-ab79-2d15cd0ff0a4 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:35.135408 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57da6ec-0e04-4321-a9bf-632e74b2ce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:35.136394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57da6ec-0e04-4321-a9bf-632e74b2ce8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:35.136870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57da6ec-0e04-4321-a9bf-632e74b2ce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:35.137167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57da6ec-0e04-4321-a9bf-632e74b2ce8b admin admin] PATH_INFO: `/v3/projects/7590060967004c279cdb6eca6df7daec/users/e41d41017b7240bda8a486fb2c7bd9c9/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:35.155124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57da6ec-0e04-4321-a9bf-632e74b2ce8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7590060967004c279cdb6eca6df7daec, user_id=e41d41017b7240bda8a486fb2c7bd9c9, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:35.155296 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4691f-0109-4677-a2ec-932dcc602540 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:35.164223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57da6ec-0e04-4321-a9bf-632e74b2ce8b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:35.225778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c8c2-e8c8-4923-8a59-b0afa9e7cc23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:35.226532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c8c2-e8c8-4923-8a59-b0afa9e7cc23 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:35.227331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c8c2-e8c8-4923-8a59-b0afa9e7cc23 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:35.227640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1c8c2-e8c8-4923-8a59-b0afa9e7cc23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:35.229455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-33c1c8c2-e8c8-4923-8a59-b0afa9e7cc23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:35.258613 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 920/1796] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:34 2022] PUT /identity/v3/projects/7590060967004c279cdb6eca6df7daec/users/e41d41017b7240bda8a486fb2c7bd9c9/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:35.260280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e89fe-78e1-47a5-a28c-90f88a1ad1a3 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:35.260572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e89fe-78e1-47a5-a28c-90f88a1ad1a3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:35.261048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e89fe-78e1-47a5-a28c-90f88a1ad1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:35.286532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-118e89fe-78e1-47a5-a28c-90f88a1ad1a3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:35.287725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-118e89fe-78e1-47a5-a28c-90f88a1ad1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:35.353847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1c8c2-e8c8-4923-8a59-b0afa9e7cc23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:35.355349 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1c8c2-e8c8-4923-8a59-b0afa9e7cc23 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:35.366878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 877/1797] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:35.367935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c8c2-e8c8-4923-8a59-b0afa9e7cc23 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:35.369436 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-33c1c8c2-e8c8-4923-8a59-b0afa9e7cc23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:35.383646 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 921/1798] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:35.384951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857b793-6da4-4432-9d76-35d390f26e9a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:35.388078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857b793-6da4-4432-9d76-35d390f26e9a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:35.388078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857b793-6da4-4432-9d76-35d390f26e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:35.446774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-9857b793-6da4-4432-9d76-35d390f26e9a None None] MFA Rules not processed for user `e41d41017b7240bda8a486fb2c7bd9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:35.450164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9857b793-6da4-4432-9d76-35d390f26e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:35.453830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1c8c2-e8c8-4923-8a59-b0afa9e7cc23 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:35.549518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b61a6-1df8-4d35-b6ab-2de1e6e7fe53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:35.550140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b61a6-1df8-4d35-b6ab-2de1e6e7fe53 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:35.550419 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b61a6-1df8-4d35-b6ab-2de1e6e7fe53 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:35.550803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b61a6-1df8-4d35-b6ab-2de1e6e7fe53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:35.574306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b61a6-1df8-4d35-b6ab-2de1e6e7fe53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:35.576259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b61a6-1df8-4d35-b6ab-2de1e6e7fe53 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:35.587799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 922/1799] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:35.589044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857b793-6da4-4432-9d76-35d390f26e9a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:35.596975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 878/1800] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:35.598606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b61a6-1df8-4d35-b6ab-2de1e6e7fe53 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:35.611767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857b793-6da4-4432-9d76-35d390f26e9a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:35.617738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b61a6-1df8-4d35-b6ab-2de1e6e7fe53 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:35.618256 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8e70a-5bd0-4bef-859b-60c20e9ef3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:35.619320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8e70a-5bd0-4bef-859b-60c20e9ef3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:35.619703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8e70a-5bd0-4bef-859b-60c20e9ef3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:35.620220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8e70a-5bd0-4bef-859b-60c20e9ef3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:35.625445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa857987-d9fc-4d18-b2ed-d3c36fcbebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:35.626176 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa857987-d9fc-4d18-b2ed-d3c36fcbebbb admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:35.626515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa857987-d9fc-4d18-b2ed-d3c36fcbebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:35.627385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa857987-d9fc-4d18-b2ed-d3c36fcbebbb admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:35.628189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa857987-d9fc-4d18-b2ed-d3c36fcbebbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:35.630725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa857987-d9fc-4d18-b2ed-d3c36fcbebbb admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:35.640778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8e70a-5bd0-4bef-859b-60c20e9ef3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:35.643742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8e70a-5bd0-4bef-859b-60c20e9ef3b5 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:35.663842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 923/1801] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:35.788056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 879/1802] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:35 2022] POST /identity/v3/projects => generated 405 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:35.791653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8e70a-5bd0-4bef-859b-60c20e9ef3b5 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:35.803616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8e70a-5bd0-4bef-859b-60c20e9ef3b5 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:35.896706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fea81-d125-4c28-8c54-5b028e81681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:35.897655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fea81-d125-4c28-8c54-5b028e81681e admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:35.897938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fea81-d125-4c28-8c54-5b028e81681e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:35.898472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fea81-d125-4c28-8c54-5b028e81681e admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:35.899270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fea81-d125-4c28-8c54-5b028e81681e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:35.901780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fea81-d125-4c28-8c54-5b028e81681e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:35.944224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa857987-d9fc-4d18-b2ed-d3c36fcbebbb admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:35.945953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-aa857987-d9fc-4d18-b2ed-d3c36fcbebbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:35.960868 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa857987-d9fc-4d18-b2ed-d3c36fcbebbb admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:35.981296 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:35.982635 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:35.983100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:35.983579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] PATH_INFO: `/v3/users/b7579c45cf00499da8e31b342b444566` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:35.985053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7579c45cf00499da8e31b342b444566)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:35.987036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:36.060182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 924/1803] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:35 2022] POST /identity/v3/users => generated 309 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:36.064037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fea81-d125-4c28-8c54-5b028e81681e admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:36.075969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fea81-d125-4c28-8c54-5b028e81681e admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:36.085559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b7ecc-3476-44aa-abc6-9a52fd28068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:36.095182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b7ecc-3476-44aa-abc6-9a52fd28068e admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:36.095182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b7ecc-3476-44aa-abc6-9a52fd28068e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:36.095182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b7ecc-3476-44aa-abc6-9a52fd28068e admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:36.095182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b7ecc-3476-44aa-abc6-9a52fd28068e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:36.095182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b7ecc-3476-44aa-abc6-9a52fd28068e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:36.105963 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 925/1804] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:36.110908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b7ecc-3476-44aa-abc6-9a52fd28068e admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:36.124410 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b7ecc-3476-44aa-abc6-9a52fd28068e admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:36.133595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767f1a2-6e1f-43ef-bde0-7c65eb978e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:36.134977 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767f1a2-6e1f-43ef-bde0-7c65eb978e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:36.135288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767f1a2-6e1f-43ef-bde0-7c65eb978e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:36.135697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767f1a2-6e1f-43ef-bde0-7c65eb978e30 admin admin] PATH_INFO: `/v3/projects/d0d058c56d844bd982b6e60063b000b6/users/5e176f6e281e411d90fb660a79914c9d/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:36.155675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767f1a2-6e1f-43ef-bde0-7c65eb978e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d058c56d844bd982b6e60063b000b6, user_id=5e176f6e281e411d90fb660a79914c9d, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:36.159387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767f1a2-6e1f-43ef-bde0-7c65eb978e30 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:36.295361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 926/1805] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:36 2022] PUT /identity/v3/projects/d0d058c56d844bd982b6e60063b000b6/users/5e176f6e281e411d90fb660a79914c9d/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:36.299780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767f1a2-6e1f-43ef-bde0-7c65eb978e30 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:36.371735 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7579c45cf00499da8e31b342b444566'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.372608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7579c45cf00499da8e31b342b444566'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.405941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767f1a2-6e1f-43ef-bde0-7c65eb978e30 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:36.411754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3a7fa-8877-45a5-9b42-b2c1e693db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:36.412408 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3a7fa-8877-45a5-9b42-b2c1e693db67 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:36.412685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3a7fa-8877-45a5-9b42-b2c1e693db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:36.412960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3a7fa-8877-45a5-9b42-b2c1e693db67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:36.413679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3a7fa-8877-45a5-9b42-b2c1e693db67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:36.415323 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3a7fa-8877-45a5-9b42-b2c1e693db67 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:36.427263 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 927/1806] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:36.436846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3a7fa-8877-45a5-9b42-b2c1e693db67 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:36.454914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3a7fa-8877-45a5-9b42-b2c1e693db67 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:36.460741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4422c5e-f6eb-48c3-b6ce-49e96f21f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:36.461825 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422c5e-f6eb-48c3-b6ce-49e96f21f5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:36.462205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422c5e-f6eb-48c3-b6ce-49e96f21f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:36.462551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4422c5e-f6eb-48c3-b6ce-49e96f21f5ff admin admin] PATH_INFO: `/v3/projects/d0d058c56d844bd982b6e60063b000b6/users/5e176f6e281e411d90fb660a79914c9d/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:36.465109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4422c5e-f6eb-48c3-b6ce-49e96f21f5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d058c56d844bd982b6e60063b000b6, user_id=5e176f6e281e411d90fb660a79914c9d, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:36.468564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4422c5e-f6eb-48c3-b6ce-49e96f21f5ff admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:36.492374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 928/1807] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:36 2022] PUT /identity/v3/projects/d0d058c56d844bd982b6e60063b000b6/users/5e176f6e281e411d90fb660a79914c9d/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:36.493467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4422c5e-f6eb-48c3-b6ce-49e96f21f5ff admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:36.495325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f4422c5e-f6eb-48c3-b6ce-49e96f21f5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:36.499819 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7579c45cf00499da8e31b342b444566'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.513507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7579c45cf00499da8e31b342b444566'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.563484 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ebae496e-345d-41f8-8095-acbd14130eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7579c45cf00499da8e31b342b444566'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.572052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 880/1808] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:35 2022] DELETE /identity/v3/users/b7579c45cf00499da8e31b342b444566 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:36.574384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cce88-ec9a-4c95-973d-b98b2ba3cc2d None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:36.574953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cce88-ec9a-4c95-973d-b98b2ba3cc2d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:36.575448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cce88-ec9a-4c95-973d-b98b2ba3cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:36.600394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4422c5e-f6eb-48c3-b6ce-49e96f21f5ff admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:36.613595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-289cce88-ec9a-4c95-973d-b98b2ba3cc2d None None] MFA Rules not processed for user `5e176f6e281e411d90fb660a79914c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:36.615143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-289cce88-ec9a-4c95-973d-b98b2ba3cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:36.667866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:36.668811 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:36.669094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:36.669371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] PATH_INFO: `/v3/projects/40c8c409e0ed4007b1840cde401cfa8d` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:36.670604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c8c409e0ed4007b1840cde401cfa8d)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:36.672558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:36.694010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 881/1809] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:36 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:36.694960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cce88-ec9a-4c95-973d-b98b2ba3cc2d None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:36.696256 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-289cce88-ec9a-4c95-973d-b98b2ba3cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:36.711567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cce88-ec9a-4c95-973d-b98b2ba3cc2d None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:36.716689 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:36.717643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:36.717973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:36.718277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] PATH_INFO: `/v3/projects/4d4175f870b749f7879eaed849d7cc22` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:36.719502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d4175f870b749f7879eaed849d7cc22)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:36.721617 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:36.784822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c8c409e0ed4007b1840cde401cfa8d', 'request_id': 'req-c953e23f-70b1-4eb2-af27-4667332848f3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.791449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c8c409e0ed4007b1840cde401cfa8d', 'request_id': 'req-c953e23f-70b1-4eb2-af27-4667332848f3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.882650 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4175f870b749f7879eaed849d7cc22', 'request_id': 'req-061f6791-7a0f-45e6-a68d-9d71027fb064'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.889912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4175f870b749f7879eaed849d7cc22', 'request_id': 'req-061f6791-7a0f-45e6-a68d-9d71027fb064'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.893800 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c8c409e0ed4007b1840cde401cfa8d', 'request_id': 'req-c953e23f-70b1-4eb2-af27-4667332848f3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.896549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4175f870b749f7879eaed849d7cc22', 'request_id': 'req-061f6791-7a0f-45e6-a68d-9d71027fb064'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.911498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] The token cache is being invalidate because project 40c8c409e0ed4007b1840cde401cfa8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:36.911859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.912671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c953e23f-70b1-4eb2-af27-4667332848f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:36.914400 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 929/1810] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:36 2022] DELETE /identity/v3/projects/40c8c409e0ed4007b1840cde401cfa8d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:36.915640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799ab56-ecd1-4b37-8793-53d755ba4193 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:36.915924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799ab56-ecd1-4b37-8793-53d755ba4193 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:36.916199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799ab56-ecd1-4b37-8793-53d755ba4193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:36.935312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-f799ab56-ecd1-4b37-8793-53d755ba4193 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:36.937010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f799ab56-ecd1-4b37-8793-53d755ba4193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:37.007610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 930/1811] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:37.007610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799ab56-ecd1-4b37-8793-53d755ba4193 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:37.007610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f799ab56-ecd1-4b37-8793-53d755ba4193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:37.058845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] The token cache is being invalidate because project 4d4175f870b749f7879eaed849d7cc22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:37.059280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.059923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.061822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 882/1812] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:36 2022] DELETE /identity/v3/projects/4d4175f870b749f7879eaed849d7cc22 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:37.063814 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:37.065701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:37.067468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799ab56-ecd1-4b37-8793-53d755ba4193 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:37.071454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e827d8-3d60-4b3c-a680-e3b7812cbf9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:37.072112 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e827d8-3d60-4b3c-a680-e3b7812cbf9a service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:37.072400 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e827d8-3d60-4b3c-a680-e3b7812cbf9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:37.072681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e827d8-3d60-4b3c-a680-e3b7812cbf9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:37.075157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-19e827d8-3d60-4b3c-a680-e3b7812cbf9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:37.080517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f6791-7a0f-45e6-a68d-9d71027fb064 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:37.085806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:37.086997 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:37.087303 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:37.087583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] PATH_INFO: `/v3/users/77c6b98b83f945a6919ad91ad01bcaff` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:37.089069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c6b98b83f945a6919ad91ad01bcaff)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:37.091195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:37.150604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e827d8-3d60-4b3c-a680-e3b7812cbf9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:37.152076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e827d8-3d60-4b3c-a680-e3b7812cbf9a service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:37.163947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 931/1813] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:37 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:37.165021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e827d8-3d60-4b3c-a680-e3b7812cbf9a service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:37.166875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-19e827d8-3d60-4b3c-a680-e3b7812cbf9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:37.233881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e827d8-3d60-4b3c-a680-e3b7812cbf9a service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:37.240172 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8d964-25aa-4d16-a7cf-7500fdeba918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:37.240829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8d964-25aa-4d16-a7cf-7500fdeba918 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:37.241109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8d964-25aa-4d16-a7cf-7500fdeba918 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:37.241423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8d964-25aa-4d16-a7cf-7500fdeba918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:37.243290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0cf8d964-25aa-4d16-a7cf-7500fdeba918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:37.256097 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8d964-25aa-4d16-a7cf-7500fdeba918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:37.257534 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8d964-25aa-4d16-a7cf-7500fdeba918 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:37.286412 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 932/1814] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:37.287847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8d964-25aa-4d16-a7cf-7500fdeba918 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:37.290379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0cf8d964-25aa-4d16-a7cf-7500fdeba918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:37.293670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c6b98b83f945a6919ad91ad01bcaff'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.297879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c6b98b83f945a6919ad91ad01bcaff'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.318753 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8d964-25aa-4d16-a7cf-7500fdeba918 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:37.331694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:37.333128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:37.333429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:37.333671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] PATH_INFO: `/v3/users/5eaa49e27c1d41cd8c7578b0ef4e34ce` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:37.335032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eaa49e27c1d41cd8c7578b0ef4e34ce)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:37.336968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:37.389850 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c6b98b83f945a6919ad91ad01bcaff'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.398110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c6b98b83f945a6919ad91ad01bcaff'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.413942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c6b98b83f945a6919ad91ad01bcaff'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.424195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 883/1815] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:37 2022] DELETE /identity/v3/users/77c6b98b83f945a6919ad91ad01bcaff => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:37.424195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:37.424195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:37.525595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9717368-3889-46b7-897b-adbe0d61e68b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:37.531131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:37.532170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:37.532566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:37.532906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] PATH_INFO: `/v3/users/e41d41017b7240bda8a486fb2c7bd9c9` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:37.534563 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41d41017b7240bda8a486fb2c7bd9c9)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:37.537537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:37.560032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eaa49e27c1d41cd8c7578b0ef4e34ce'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.591804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eaa49e27c1d41cd8c7578b0ef4e34ce'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.675830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eaa49e27c1d41cd8c7578b0ef4e34ce'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.706609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eaa49e27c1d41cd8c7578b0ef4e34ce'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.708328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5f3b14b8-ba69-47f5-92fa-ef8081253b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eaa49e27c1d41cd8c7578b0ef4e34ce'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.716548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 933/1816] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:37 2022] DELETE /identity/v3/users/5eaa49e27c1d41cd8c7578b0ef4e34ce => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:37.760885 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41d41017b7240bda8a486fb2c7bd9c9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.763157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41d41017b7240bda8a486fb2c7bd9c9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.841590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41d41017b7240bda8a486fb2c7bd9c9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.851594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41d41017b7240bda8a486fb2c7bd9c9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.886739 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41d41017b7240bda8a486fb2c7bd9c9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:37.899989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 884/1817] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:37 2022] DELETE /identity/v3/users/e41d41017b7240bda8a486fb2c7bd9c9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:37.901452 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd5bdb-e95b-488a-bebd-02e22b0bdc03 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:37.901778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd5bdb-e95b-488a-bebd-02e22b0bdc03 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:37.902616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd5bdb-e95b-488a-bebd-02e22b0bdc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:37.946152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-48dd5bdb-e95b-488a-bebd-02e22b0bdc03 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:37.947223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-48dd5bdb-e95b-488a-bebd-02e22b0bdc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:38.045855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 934/1818] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:38.060663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:38.062442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:38.168130 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b79056-0ae0-411a-a657-e3a11a1689dd admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:38.173437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ff0b9-3f7a-4c55-b6c4-f55d530b8fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:38.174546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ff0b9-3f7a-4c55-b6c4-f55d530b8fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:38.175035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ff0b9-3f7a-4c55-b6c4-f55d530b8fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:38.176816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ff0b9-3f7a-4c55-b6c4-f55d530b8fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:38.191336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ff0b9-3f7a-4c55-b6c4-f55d530b8fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:38.193559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ff0b9-3f7a-4c55-b6c4-f55d530b8fd0 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:38.205514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 885/1819] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:38.215208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd5bdb-e95b-488a-bebd-02e22b0bdc03 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:38.216859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-48dd5bdb-e95b-488a-bebd-02e22b0bdc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:38.243789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd5bdb-e95b-488a-bebd-02e22b0bdc03 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:38.244248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:38.245323 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:38.245650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:38.245926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] PATH_INFO: `/v3/projects/e851f1c73695479cb679f5eda6d927bb` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:38.247991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e851f1c73695479cb679f5eda6d927bb)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:38.250634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:38.316334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ff0b9-3f7a-4c55-b6c4-f55d530b8fd0 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:38.318263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6f5ff0b9-3f7a-4c55-b6c4-f55d530b8fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:38.337228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ff0b9-3f7a-4c55-b6c4-f55d530b8fd0 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:38.346786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:38.350018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:38.350346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:38.350629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] PATH_INFO: `/v3/projects/bc96eb81558243b4965af0724959ecd5` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:38.352353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc96eb81558243b4965af0724959ecd5)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:38.354632 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:38.437574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e851f1c73695479cb679f5eda6d927bb', 'request_id': 'req-e0e76971-328b-431c-a2f2-ae3348ae6265'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.445636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e851f1c73695479cb679f5eda6d927bb', 'request_id': 'req-e0e76971-328b-431c-a2f2-ae3348ae6265'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.549446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc96eb81558243b4965af0724959ecd5', 'request_id': 'req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.557783 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc96eb81558243b4965af0724959ecd5', 'request_id': 'req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.561736 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e851f1c73695479cb679f5eda6d927bb', 'request_id': 'req-e0e76971-328b-431c-a2f2-ae3348ae6265'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.582180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] The token cache is being invalidate because project e851f1c73695479cb679f5eda6d927bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:38.582553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.583847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.590970 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 935/1820] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:38 2022] DELETE /identity/v3/projects/e851f1c73695479cb679f5eda6d927bb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:38.590970 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:38.591203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc96eb81558243b4965af0724959ecd5', 'request_id': 'req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.592039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:38.677026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e76971-328b-431c-a2f2-ae3348ae6265 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:38.753975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] The token cache is being invalidate because project bc96eb81558243b4965af0724959ecd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:38.754425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.755472 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.756577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:38.757470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:38.757753 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:38.757906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 886/1821] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:38 2022] DELETE /identity/v3/projects/bc96eb81558243b4965af0724959ecd5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:38.758088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] PATH_INFO: `/v3/projects/6dd4dfe39c8c4fedb0050725c7ed5c00` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:38.759490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd4dfe39c8c4fedb0050725c7ed5c00)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:38.759681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:38.761414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:38.761687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:38.779195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2671c-0a1b-41bf-9656-f35ab2c4cef0 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:38.785194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:38.786421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:38.786728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:38.786984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] PATH_INFO: `/v3/users/b0d110458b134175838288d47a5d8930` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:38.788276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d110458b134175838288d47a5d8930)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:38.790401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:38.929063 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd4dfe39c8c4fedb0050725c7ed5c00', 'request_id': 'req-e72c9541-ead1-4272-b7f6-b2e9494c364e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:38.936075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd4dfe39c8c4fedb0050725c7ed5c00', 'request_id': 'req-e72c9541-ead1-4272-b7f6-b2e9494c364e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.101389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d110458b134175838288d47a5d8930'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.102183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d110458b134175838288d47a5d8930'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.150715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd4dfe39c8c4fedb0050725c7ed5c00', 'request_id': 'req-e72c9541-ead1-4272-b7f6-b2e9494c364e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.161922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] The token cache is being invalidate because project 6dd4dfe39c8c4fedb0050725c7ed5c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:39.162279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.162993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e72c9541-ead1-4272-b7f6-b2e9494c364e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.164581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 936/1822] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:38 2022] DELETE /identity/v3/projects/6dd4dfe39c8c4fedb0050725c7ed5c00 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:39.166047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6fdd9-21ae-44bc-97a6-b563e0e01f10 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:39.166238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6fdd9-21ae-44bc-97a6-b563e0e01f10 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:39.166512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6fdd9-21ae-44bc-97a6-b563e0e01f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:39.184759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-21e6fdd9-21ae-44bc-97a6-b563e0e01f10 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:39.185878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-21e6fdd9-21ae-44bc-97a6-b563e0e01f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:39.245616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 937/1823] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:39.246558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6fdd9-21ae-44bc-97a6-b563e0e01f10 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:39.247804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-21e6fdd9-21ae-44bc-97a6-b563e0e01f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:39.260483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6fdd9-21ae-44bc-97a6-b563e0e01f10 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:39.264348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d110458b134175838288d47a5d8930'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.265398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:39.266462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:39.266744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:39.267020 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] PATH_INFO: `/v3/projects/7590060967004c279cdb6eca6df7daec` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:39.268213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7590060967004c279cdb6eca6df7daec)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:39.270226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:39.274897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d110458b134175838288d47a5d8930'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.292348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-927ba909-7162-4f88-89db-d69cfba6aefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d110458b134175838288d47a5d8930'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.298566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 887/1824] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:38 2022] DELETE /identity/v3/users/b0d110458b134175838288d47a5d8930 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:39.300012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40c93-3894-469a-a3f8-16766f4e0614 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:39.300298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40c93-3894-469a-a3f8-16766f4e0614 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:39.301492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40c93-3894-469a-a3f8-16766f4e0614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:39.331150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-d7b40c93-3894-469a-a3f8-16766f4e0614 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:39.332709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d7b40c93-3894-469a-a3f8-16766f4e0614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:39.396056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 888/1825] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:39.397448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb61435-b1a2-4c18-bf4a-8299a7813447 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:39.397737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb61435-b1a2-4c18-bf4a-8299a7813447 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:39.398023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb61435-b1a2-4c18-bf4a-8299a7813447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:39.416402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-5fb61435-b1a2-4c18-bf4a-8299a7813447 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:39.417647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5fb61435-b1a2-4c18-bf4a-8299a7813447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:39.421735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7590060967004c279cdb6eca6df7daec', 'request_id': 'req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.428510 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7590060967004c279cdb6eca6df7daec', 'request_id': 'req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.476325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 889/1826] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:39.477540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13168cbe-0798-47e6-ad5c-8e1dac935bc8 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:39.477851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13168cbe-0798-47e6-ad5c-8e1dac935bc8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:39.478188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13168cbe-0798-47e6-ad5c-8e1dac935bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:39.500262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-13168cbe-0798-47e6-ad5c-8e1dac935bc8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:39.502752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-13168cbe-0798-47e6-ad5c-8e1dac935bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:39.515974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 890/1827] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:39.516589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7590060967004c279cdb6eca6df7daec', 'request_id': 'req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.517198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13168cbe-0798-47e6-ad5c-8e1dac935bc8 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:39.539508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13168cbe-0798-47e6-ad5c-8e1dac935bc8 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:39.545220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55edfc-b8e8-4be9-ab77-d603a0262a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:39.545983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55edfc-b8e8-4be9-ab77-d603a0262a3b admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:39.546245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] The token cache is being invalidate because project 7590060967004c279cdb6eca6df7daec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:39.546397 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55edfc-b8e8-4be9-ab77-d603a0262a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:39.546539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.546714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55edfc-b8e8-4be9-ab77-d603a0262a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:39.547382 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.547609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55edfc-b8e8-4be9-ab77-d603a0262a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:39.547995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55edfc-b8e8-4be9-ab77-d603a0262a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:39.549214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 938/1828] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:39 2022] DELETE /identity/v3/projects/7590060967004c279cdb6eca6df7daec => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:39.549627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55edfc-b8e8-4be9-ab77-d603a0262a3b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:39.551653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:39.553775 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:39.567837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 891/1829] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:56:39.567837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55edfc-b8e8-4be9-ab77-d603a0262a3b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:39.568060 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3e55edfc-b8e8-4be9-ab77-d603a0262a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:39.572588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63457dbf-66bf-42f2-b41f-2cc1789d8a2a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:39.578818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf063e-ddd9-4406-a7c4-5d9a48052e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:39.579655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf063e-ddd9-4406-a7c4-5d9a48052e8a admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:39.579942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf063e-ddd9-4406-a7c4-5d9a48052e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:39.580220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf063e-ddd9-4406-a7c4-5d9a48052e8a admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:39.580954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf063e-ddd9-4406-a7c4-5d9a48052e8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:39.581258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf063e-ddd9-4406-a7c4-5d9a48052e8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:39.583870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55edfc-b8e8-4be9-ab77-d603a0262a3b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:39.584451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf063e-ddd9-4406-a7c4-5d9a48052e8a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:39.592164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:39.593055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:39.593336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:39.593608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] PATH_INFO: `/v3/users/5e176f6e281e411d90fb660a79914c9d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:39.595151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e176f6e281e411d90fb660a79914c9d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:39.597078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:39.612043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 939/1830] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:56:39.612987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf063e-ddd9-4406-a7c4-5d9a48052e8a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:39.615988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1edf063e-ddd9-4406-a7c4-5d9a48052e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:39.630583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf063e-ddd9-4406-a7c4-5d9a48052e8a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:39.637618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fadfb0-f6a2-497e-a582-7c45c3cbcbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:39.638396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fadfb0-f6a2-497e-a582-7c45c3cbcbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:39.638683 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fadfb0-f6a2-497e-a582-7c45c3cbcbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:39.638963 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fadfb0-f6a2-497e-a582-7c45c3cbcbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:39.639678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fadfb0-f6a2-497e-a582-7c45c3cbcbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:39.641605 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fadfb0-f6a2-497e-a582-7c45c3cbcbb2 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:39.742362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 940/1831] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:39 2022] POST /identity/v3/projects => generated 407 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:39.743586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fadfb0-f6a2-497e-a582-7c45c3cbcbb2 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:39.822268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fadfb0-f6a2-497e-a582-7c45c3cbcbb2 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:39.828397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f919a-5ab6-446f-9245-747d42c433c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:39.829080 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f919a-5ab6-446f-9245-747d42c433c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:39.829480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f919a-5ab6-446f-9245-747d42c433c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:39.829906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f919a-5ab6-446f-9245-747d42c433c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:39.830756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f919a-5ab6-446f-9245-747d42c433c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:39.834672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f919a-5ab6-446f-9245-747d42c433c0 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:39.851879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e176f6e281e411d90fb660a79914c9d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.852672 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e176f6e281e411d90fb660a79914c9d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.938080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e176f6e281e411d90fb660a79914c9d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.945939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e176f6e281e411d90fb660a79914c9d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.957796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e176f6e281e411d90fb660a79914c9d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:39.964112 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 892/1832] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:39 2022] DELETE /identity/v3/users/5e176f6e281e411d90fb660a79914c9d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:39.967729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:39.969207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:39.995307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 941/1833] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:39 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:39.999133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f919a-5ab6-446f-9245-747d42c433c0 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:40.011490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1d7f919a-5ab6-446f-9245-747d42c433c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:40.092895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73610dc7-05a8-4100-9c53-34c2cea16c85 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:40.111244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f919a-5ab6-446f-9245-747d42c433c0 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:40.116868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40794cf-e450-4536-80ba-70f52abb59db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:40.117546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40794cf-e450-4536-80ba-70f52abb59db admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.117829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40794cf-e450-4536-80ba-70f52abb59db admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.119417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40794cf-e450-4536-80ba-70f52abb59db admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.122833 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40794cf-e450-4536-80ba-70f52abb59db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:40.122833 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40794cf-e450-4536-80ba-70f52abb59db admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:40.161291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874db4d-b5d8-4f9a-840c-d3b11f81b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:40.162211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874db4d-b5d8-4f9a-840c-d3b11f81b901 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.162497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874db4d-b5d8-4f9a-840c-d3b11f81b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.162774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874db4d-b5d8-4f9a-840c-d3b11f81b901 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.163710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874db4d-b5d8-4f9a-840c-d3b11f81b901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:40.165692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874db4d-b5d8-4f9a-840c-d3b11f81b901 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:40.241179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 942/1834] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:39 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:40.242183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40794cf-e450-4536-80ba-70f52abb59db admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:40.244079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a40794cf-e450-4536-80ba-70f52abb59db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:40.257268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40794cf-e450-4536-80ba-70f52abb59db admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:40.262176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:40.263119 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.263428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.263734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] PATH_INFO: `/v3/projects/9ee9444de654400ab1fc89606d7d3794` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.264964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee9444de654400ab1fc89606d7d3794)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:40.267074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:40.300108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 893/1835] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:39 2022] POST /identity/v3/users => generated 304 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:40.301060 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874db4d-b5d8-4f9a-840c-d3b11f81b901 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:40.312020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874db4d-b5d8-4f9a-840c-d3b11f81b901 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:40.317440 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49993db8-c350-4308-a946-b72ab16aba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:40.318300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49993db8-c350-4308-a946-b72ab16aba07 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.318571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49993db8-c350-4308-a946-b72ab16aba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.318842 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49993db8-c350-4308-a946-b72ab16aba07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.319570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49993db8-c350-4308-a946-b72ab16aba07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:40.322792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49993db8-c350-4308-a946-b72ab16aba07 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:40.334195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 894/1836] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:40.334864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49993db8-c350-4308-a946-b72ab16aba07 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:40.345228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49993db8-c350-4308-a946-b72ab16aba07 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:40.350169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aca82b-3e0e-4971-95af-498eb15fc88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:40.353066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca82b-3e0e-4971-95af-498eb15fc88d admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.353066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca82b-3e0e-4971-95af-498eb15fc88d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.353066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aca82b-3e0e-4971-95af-498eb15fc88d admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.353066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aca82b-3e0e-4971-95af-498eb15fc88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:40.353618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aca82b-3e0e-4971-95af-498eb15fc88d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:40.368068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 895/1837] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:40.368068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aca82b-3e0e-4971-95af-498eb15fc88d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:40.375114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aca82b-3e0e-4971-95af-498eb15fc88d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:40.380234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820ef3-66d6-41ad-a1b2-a56ff6586f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:40.381044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820ef3-66d6-41ad-a1b2-a56ff6586f12 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.381405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820ef3-66d6-41ad-a1b2-a56ff6586f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.381724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa820ef3-66d6-41ad-a1b2-a56ff6586f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.386928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa820ef3-66d6-41ad-a1b2-a56ff6586f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:40.386928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa820ef3-66d6-41ad-a1b2-a56ff6586f12 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:40.400817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 896/1838] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:40.401856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820ef3-66d6-41ad-a1b2-a56ff6586f12 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:40.417714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa820ef3-66d6-41ad-a1b2-a56ff6586f12 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:40.453758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee9444de654400ab1fc89606d7d3794', 'request_id': 'req-60ee2099-e6fc-4946-91a9-8faad95f09a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:40.463054 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee9444de654400ab1fc89606d7d3794', 'request_id': 'req-60ee2099-e6fc-4946-91a9-8faad95f09a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:40.500920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b21b6-0065-4846-b82c-dbc31a6f98d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:40.502090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b21b6-0065-4846-b82c-dbc31a6f98d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.502090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b21b6-0065-4846-b82c-dbc31a6f98d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.502243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b21b6-0065-4846-b82c-dbc31a6f98d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.503029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b21b6-0065-4846-b82c-dbc31a6f98d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:40.504717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b21b6-0065-4846-b82c-dbc31a6f98d1 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:40.515498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 897/1839] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:40.516231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b21b6-0065-4846-b82c-dbc31a6f98d1 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:40.526931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b21b6-0065-4846-b82c-dbc31a6f98d1 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:40.532412 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130360e-0af7-4afd-8e9d-34126178401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:40.533377 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130360e-0af7-4afd-8e9d-34126178401d admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.533729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130360e-0af7-4afd-8e9d-34126178401d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.534076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130360e-0af7-4afd-8e9d-34126178401d admin admin] PATH_INFO: `/v3/projects/ab5b075e9763485e9c18123f2eaa4ff8/users/fed43a9cd1544c5fb995c7e28cba4d7c/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.549869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130360e-0af7-4afd-8e9d-34126178401d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5b075e9763485e9c18123f2eaa4ff8, user_id=fed43a9cd1544c5fb995c7e28cba4d7c, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:40.554375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130360e-0af7-4afd-8e9d-34126178401d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:40.590640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee9444de654400ab1fc89606d7d3794', 'request_id': 'req-60ee2099-e6fc-4946-91a9-8faad95f09a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:40.606538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] The token cache is being invalidate because project 9ee9444de654400ab1fc89606d7d3794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:40.606934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:40.608246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:40.610505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 943/1840] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:40 2022] DELETE /identity/v3/projects/9ee9444de654400ab1fc89606d7d3794 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:40.611569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:40.624707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:40.637275 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 898/1841] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:40 2022] PUT /identity/v3/projects/ab5b075e9763485e9c18123f2eaa4ff8/users/fed43a9cd1544c5fb995c7e28cba4d7c/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:40.638294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130360e-0af7-4afd-8e9d-34126178401d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:40.638916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee2099-e6fc-4946-91a9-8faad95f09a6 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:40.646374 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b130360e-0af7-4afd-8e9d-34126178401d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:40.701769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40281fec-a141-4a97-8fd1-967a9310f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:40.702900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281fec-a141-4a97-8fd1-967a9310f79b admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.703188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281fec-a141-4a97-8fd1-967a9310f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.703486 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281fec-a141-4a97-8fd1-967a9310f79b admin admin] PATH_INFO: `/v3/projects/4344ec88553f421f843315c25ce06387/users/816a886c41a646f693e9fbf039e09c51/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.711708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130360e-0af7-4afd-8e9d-34126178401d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:40.716755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:40.720948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.720948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.720948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] PATH_INFO: `/v3/projects/d0d058c56d844bd982b6e60063b000b6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.721189 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40281fec-a141-4a97-8fd1-967a9310f79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4344ec88553f421f843315c25ce06387, user_id=816a886c41a646f693e9fbf039e09c51, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:40.721277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d058c56d844bd982b6e60063b000b6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:40.721494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:40.721824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40281fec-a141-4a97-8fd1-967a9310f79b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:40.906142 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 944/1842] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:40 2022] PUT /identity/v3/projects/4344ec88553f421f843315c25ce06387/users/816a886c41a646f693e9fbf039e09c51/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:40.907886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa4cb-3699-40ce-b9f4-b68915fb05ba None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:40.908203 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa4cb-3699-40ce-b9f4-b68915fb05ba None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:40.908506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaa4cb-3699-40ce-b9f4-b68915fb05ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:40.912056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d058c56d844bd982b6e60063b000b6', 'request_id': 'req-88c449bf-5e12-4308-96fa-b91d25a3dc65'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:40.920074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d058c56d844bd982b6e60063b000b6', 'request_id': 'req-88c449bf-5e12-4308-96fa-b91d25a3dc65'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:40.928270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d058c56d844bd982b6e60063b000b6', 'request_id': 'req-88c449bf-5e12-4308-96fa-b91d25a3dc65'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:40.934748 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-06eaa4cb-3699-40ce-b9f4-b68915fb05ba None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:40.936137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-06eaa4cb-3699-40ce-b9f4-b68915fb05ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:41.020970 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 945/1843] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:41.020970 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580253b5-074a-4304-8415-106234582379 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.020970 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580253b5-074a-4304-8415-106234582379 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.020970 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580253b5-074a-4304-8415-106234582379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.044395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] The token cache is being invalidate because project d0d058c56d844bd982b6e60063b000b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:41.045178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:41.046002 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-88c449bf-5e12-4308-96fa-b91d25a3dc65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:41.047782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-580253b5-074a-4304-8415-106234582379 None None] MFA Rules not processed for user `fed43a9cd1544c5fb995c7e28cba4d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:41.048093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 899/1844] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:40 2022] DELETE /identity/v3/projects/d0d058c56d844bd982b6e60063b000b6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:41.049098 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-580253b5-074a-4304-8415-106234582379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:41.049390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdd320-b908-4142-b50c-8fc22594b852 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.049677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdd320-b908-4142-b50c-8fc22594b852 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.049973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdd320-b908-4142-b50c-8fc22594b852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.081125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-7dcdd320-b908-4142-b50c-8fc22594b852 None None] MFA Rules not processed for user `816a886c41a646f693e9fbf039e09c51`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:41.083139 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7dcdd320-b908-4142-b50c-8fc22594b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:41.136350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 946/1845] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:41.136350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573272fa-d9f1-4576-80e4-badbc13085a9 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.136350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573272fa-d9f1-4576-80e4-badbc13085a9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.136350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573272fa-d9f1-4576-80e4-badbc13085a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.167014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-573272fa-d9f1-4576-80e4-badbc13085a9 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:41.169192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-573272fa-d9f1-4576-80e4-badbc13085a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:41.181915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 947/1846] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:41.182932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 900/1847] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:41.183888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdd320-b908-4142-b50c-8fc22594b852 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.184107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bbace-bbca-4b8f-be2d-d7388493841d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.184569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bbace-bbca-4b8f-be2d-d7388493841d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.184853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bbace-bbca-4b8f-be2d-d7388493841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.186212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7dcdd320-b908-4142-b50c-8fc22594b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:41.203987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdd320-b908-4142-b50c-8fc22594b852 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.210829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03990501-f039-4080-9d42-51702321cfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.212688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990501-f039-4080-9d42-51702321cfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.212688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990501-f039-4080-9d42-51702321cfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.212688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990501-f039-4080-9d42-51702321cfe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.213120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03990501-f039-4080-9d42-51702321cfe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.215434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03990501-f039-4080-9d42-51702321cfe1 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.216452 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-6c0bbace-bbca-4b8f-be2d-d7388493841d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:41.217168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-6c0bbace-bbca-4b8f-be2d-d7388493841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:41.232546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 948/1848] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:41.233569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bbace-bbca-4b8f-be2d-d7388493841d None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.244827 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bbace-bbca-4b8f-be2d-d7388493841d None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.256160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61482-5a0c-4426-80dc-3e4007884bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.256831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61482-5a0c-4426-80dc-3e4007884bfd admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.257114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61482-5a0c-4426-80dc-3e4007884bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.257387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc61482-5a0c-4426-80dc-3e4007884bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.258353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc61482-5a0c-4426-80dc-3e4007884bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:41.258426 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc61482-5a0c-4426-80dc-3e4007884bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.259996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc61482-5a0c-4426-80dc-3e4007884bfd admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.280284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 949/1849] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:56:41.280284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61482-5a0c-4426-80dc-3e4007884bfd admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.281832 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-bfc61482-5a0c-4426-80dc-3e4007884bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:41.296325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc61482-5a0c-4426-80dc-3e4007884bfd admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.301296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa17c2f-5358-4add-9d3b-d7f09e975080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.301754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17c2f-5358-4add-9d3b-d7f09e975080 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.302404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17c2f-5358-4add-9d3b-d7f09e975080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.302404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa17c2f-5358-4add-9d3b-d7f09e975080 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.303336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa17c2f-5358-4add-9d3b-d7f09e975080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.305241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa17c2f-5358-4add-9d3b-d7f09e975080 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.352070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 901/1850] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:41.353409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17affa-6155-4802-8473-96e3766c5b08 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.353694 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17affa-6155-4802-8473-96e3766c5b08 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.353965 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17affa-6155-4802-8473-96e3766c5b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.372358 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ee17affa-6155-4802-8473-96e3766c5b08 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:41.373668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ee17affa-6155-4802-8473-96e3766c5b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:41.431013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 902/1851] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:41.431852 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17affa-6155-4802-8473-96e3766c5b08 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.440751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17affa-6155-4802-8473-96e3766c5b08 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.445932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf10f1-32d0-4c8a-ad90-dee94cbb691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.446605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf10f1-32d0-4c8a-ad90-dee94cbb691e admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.446890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf10f1-32d0-4c8a-ad90-dee94cbb691e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.447167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf10f1-32d0-4c8a-ad90-dee94cbb691e admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.447852 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf10f1-32d0-4c8a-ad90-dee94cbb691e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.450387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf10f1-32d0-4c8a-ad90-dee94cbb691e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.494493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 950/1852] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/projects => generated 409 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:41.495463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa17c2f-5358-4add-9d3b-d7f09e975080 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.556547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa17c2f-5358-4add-9d3b-d7f09e975080 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.561541 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d306a-3df1-4436-ba8c-5e6122a63451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.562328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d306a-3df1-4436-ba8c-5e6122a63451 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.562609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d306a-3df1-4436-ba8c-5e6122a63451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.562883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d306a-3df1-4436-ba8c-5e6122a63451 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.563583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d306a-3df1-4436-ba8c-5e6122a63451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.565616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d306a-3df1-4436-ba8c-5e6122a63451 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.566686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 903/1853] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:41.567652 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf10f1-32d0-4c8a-ad90-dee94cbb691e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.631685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf10f1-32d0-4c8a-ad90-dee94cbb691e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.636540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253214e-515b-4988-840f-086dc7203078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.637224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253214e-515b-4988-840f-086dc7203078 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.637601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253214e-515b-4988-840f-086dc7203078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.637880 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253214e-515b-4988-840f-086dc7203078 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.638630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253214e-515b-4988-840f-086dc7203078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:41.638931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253214e-515b-4988-840f-086dc7203078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.640508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253214e-515b-4988-840f-086dc7203078 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.652372 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 904/1854] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:56:41.653224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253214e-515b-4988-840f-086dc7203078 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.656516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 951/1855] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:41.657383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d306a-3df1-4436-ba8c-5e6122a63451 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.665353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253214e-515b-4988-840f-086dc7203078 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.668492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d306a-3df1-4436-ba8c-5e6122a63451 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.675596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f060c3-4fe0-4316-b4f8-1af5d3a191da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.675596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f060c3-4fe0-4316-b4f8-1af5d3a191da admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.675596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f060c3-4fe0-4316-b4f8-1af5d3a191da admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.675596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f060c3-4fe0-4316-b4f8-1af5d3a191da admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.676548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f060c3-4fe0-4316-b4f8-1af5d3a191da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.676649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54296667-fe95-4560-ba82-6e573ba90f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.676649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54296667-fe95-4560-ba82-6e573ba90f62 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.676649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54296667-fe95-4560-ba82-6e573ba90f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.676835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f060c3-4fe0-4316-b4f8-1af5d3a191da admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.676899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54296667-fe95-4560-ba82-6e573ba90f62 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.676899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54296667-fe95-4560-ba82-6e573ba90f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.678013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54296667-fe95-4560-ba82-6e573ba90f62 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.814022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 905/1856] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:41.815301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f060c3-4fe0-4316-b4f8-1af5d3a191da admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.824766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f060c3-4fe0-4316-b4f8-1af5d3a191da admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.829417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cb541-3b59-45b2-abc3-7e3f9d1f8015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.830081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cb541-3b59-45b2-abc3-7e3f9d1f8015 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.830365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cb541-3b59-45b2-abc3-7e3f9d1f8015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.830638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cb541-3b59-45b2-abc3-7e3f9d1f8015 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.831318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cb541-3b59-45b2-abc3-7e3f9d1f8015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.833760 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cb541-3b59-45b2-abc3-7e3f9d1f8015 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.855545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 952/1857] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:41.855545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54296667-fe95-4560-ba82-6e573ba90f62 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.864575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54296667-fe95-4560-ba82-6e573ba90f62 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.869311 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a7b8-b50a-4a84-b484-ca042b7eb060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.869959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a7b8-b50a-4a84-b484-ca042b7eb060 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.870293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a7b8-b50a-4a84-b484-ca042b7eb060 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.870571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a7b8-b50a-4a84-b484-ca042b7eb060 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.871322 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0a7b8-b50a-4a84-b484-ca042b7eb060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.872921 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0a7b8-b50a-4a84-b484-ca042b7eb060 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.882643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 953/1858] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:41.883529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a7b8-b50a-4a84-b484-ca042b7eb060 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.892666 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a7b8-b50a-4a84-b484-ca042b7eb060 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.899434 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1560a6a-a49c-44f3-947c-3bb71581c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.900064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1560a6a-a49c-44f3-947c-3bb71581c0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.900346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1560a6a-a49c-44f3-947c-3bb71581c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.900622 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1560a6a-a49c-44f3-947c-3bb71581c0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.901339 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1560a6a-a49c-44f3-947c-3bb71581c0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.904663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1560a6a-a49c-44f3-947c-3bb71581c0a5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.913669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 954/1859] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:41.914617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1560a6a-a49c-44f3-947c-3bb71581c0a5 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.923870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1560a6a-a49c-44f3-947c-3bb71581c0a5 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.928673 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d77e4-3d6c-42bd-b8c7-fb00de7e31db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.929288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d77e4-3d6c-42bd-b8c7-fb00de7e31db admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.929570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d77e4-3d6c-42bd-b8c7-fb00de7e31db admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.929842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d77e4-3d6c-42bd-b8c7-fb00de7e31db admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.930567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d77e4-3d6c-42bd-b8c7-fb00de7e31db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.932140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d77e4-3d6c-42bd-b8c7-fb00de7e31db admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:41.941500 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 955/1860] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:41.942833 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d77e4-3d6c-42bd-b8c7-fb00de7e31db admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:41.951797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d77e4-3d6c-42bd-b8c7-fb00de7e31db admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:41.956346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3984dc-2636-42dd-ad5f-6592482ad846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:41.957819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3984dc-2636-42dd-ad5f-6592482ad846 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:41.958127 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3984dc-2636-42dd-ad5f-6592482ad846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:41.958404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3984dc-2636-42dd-ad5f-6592482ad846 admin admin] PATH_INFO: `/v3/projects/4f9e39aa611a43cc80191aa798f3a8e4/users/d2ba08576f6a45959e509152eb47ebd2/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:41.974152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3984dc-2636-42dd-ad5f-6592482ad846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9e39aa611a43cc80191aa798f3a8e4, user_id=d2ba08576f6a45959e509152eb47ebd2, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:41.976777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3984dc-2636-42dd-ad5f-6592482ad846 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.002983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 906/1861] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:41 2022] POST /identity/v3/projects => generated 403 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:42.004453 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cb541-3b59-45b2-abc3-7e3f9d1f8015 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.064985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cb541-3b59-45b2-abc3-7e3f9d1f8015 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.070478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0666de-d17e-4fcb-8ce4-a49b61b0b2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.071380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0666de-d17e-4fcb-8ce4-a49b61b0b2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.071663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0666de-d17e-4fcb-8ce4-a49b61b0b2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.071947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0666de-d17e-4fcb-8ce4-a49b61b0b2f7 admin admin] PATH_INFO: `/v3/projects/767dbd54817a4dc49f66b30f46919e54/users/2f10de3b7d6b492fb9a4aee600ae634c/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.077274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 956/1862] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:41 2022] PUT /identity/v3/projects/4f9e39aa611a43cc80191aa798f3a8e4/users/d2ba08576f6a45959e509152eb47ebd2/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:42.078245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3984dc-2636-42dd-ad5f-6592482ad846 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.086804 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0666de-d17e-4fcb-8ce4-a49b61b0b2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767dbd54817a4dc49f66b30f46919e54, user_id=2f10de3b7d6b492fb9a4aee600ae634c, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.089754 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0666de-d17e-4fcb-8ce4-a49b61b0b2f7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.139699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3984dc-2636-42dd-ad5f-6592482ad846 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.144428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71aa2a-0092-40b8-9230-33756244a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.145214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71aa2a-0092-40b8-9230-33756244a855 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.145395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71aa2a-0092-40b8-9230-33756244a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.145636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71aa2a-0092-40b8-9230-33756244a855 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.146521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71aa2a-0092-40b8-9230-33756244a855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.148232 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71aa2a-0092-40b8-9230-33756244a855 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.159315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 957/1863] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:42.159315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71aa2a-0092-40b8-9230-33756244a855 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.170243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71aa2a-0092-40b8-9230-33756244a855 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.177863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ad24f-91c3-4a50-ab3a-0f9f017263e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.178616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ad24f-91c3-4a50-ab3a-0f9f017263e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.178899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ad24f-91c3-4a50-ab3a-0f9f017263e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.179171 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ad24f-91c3-4a50-ab3a-0f9f017263e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.179934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ad24f-91c3-4a50-ab3a-0f9f017263e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.182059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ad24f-91c3-4a50-ab3a-0f9f017263e7 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.205273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 907/1864] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:42 2022] PUT /identity/v3/projects/767dbd54817a4dc49f66b30f46919e54/users/2f10de3b7d6b492fb9a4aee600ae634c/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:42.206140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0666de-d17e-4fcb-8ce4-a49b61b0b2f7 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.273829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0666de-d17e-4fcb-8ce4-a49b61b0b2f7 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.279872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ff271-89bb-4239-982e-9861fe55f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.280477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff271-89bb-4239-982e-9861fe55f251 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.280863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff271-89bb-4239-982e-9861fe55f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.281145 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ff271-89bb-4239-982e-9861fe55f251 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.281983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ff271-89bb-4239-982e-9861fe55f251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.283693 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ff271-89bb-4239-982e-9861fe55f251 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.296271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 908/1865] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:42.297093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ff271-89bb-4239-982e-9861fe55f251 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.311361 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ff271-89bb-4239-982e-9861fe55f251 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.317310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c05f9-ff1b-40a4-a546-10aec03de3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.318388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c05f9-ff1b-40a4-a546-10aec03de3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.318677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c05f9-ff1b-40a4-a546-10aec03de3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.319006 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c05f9-ff1b-40a4-a546-10aec03de3c3 admin admin] PATH_INFO: `/v3/projects/f2be3ec599bd4b918a05c5070afa5469/users/48592265bf6a4e619c162c1c01187858/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.335928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c05f9-ff1b-40a4-a546-10aec03de3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2be3ec599bd4b918a05c5070afa5469, user_id=48592265bf6a4e619c162c1c01187858, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.348122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c05f9-ff1b-40a4-a546-10aec03de3c3 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.352266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 958/1866] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:42 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:42.352266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ad24f-91c3-4a50-ab3a-0f9f017263e7 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.361275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ad24f-91c3-4a50-ab3a-0f9f017263e7 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.367252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d06eef-2121-4143-8ae0-f54f18700f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.367922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d06eef-2121-4143-8ae0-f54f18700f97 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.368209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d06eef-2121-4143-8ae0-f54f18700f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.368488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d06eef-2121-4143-8ae0-f54f18700f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.369220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d06eef-2121-4143-8ae0-f54f18700f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.370929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d06eef-2121-4143-8ae0-f54f18700f97 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.384920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 959/1867] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:42.384920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d06eef-2121-4143-8ae0-f54f18700f97 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.396321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d06eef-2121-4143-8ae0-f54f18700f97 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.401154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eadfe-fca8-408c-bf8b-fbdc4cf664cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.402084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eadfe-fca8-408c-bf8b-fbdc4cf664cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.402365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eadfe-fca8-408c-bf8b-fbdc4cf664cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.402638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9eadfe-fca8-408c-bf8b-fbdc4cf664cd admin admin] PATH_INFO: `/v3/projects/4f9e39aa611a43cc80191aa798f3a8e4/users/d2ba08576f6a45959e509152eb47ebd2/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.404851 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9eadfe-fca8-408c-bf8b-fbdc4cf664cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9e39aa611a43cc80191aa798f3a8e4, user_id=d2ba08576f6a45959e509152eb47ebd2, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.407711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9eadfe-fca8-408c-bf8b-fbdc4cf664cd admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.418688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 960/1868] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:42 2022] PUT /identity/v3/projects/4f9e39aa611a43cc80191aa798f3a8e4/users/d2ba08576f6a45959e509152eb47ebd2/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:42.419466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eadfe-fca8-408c-bf8b-fbdc4cf664cd admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.469660 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 909/1869] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:42 2022] PUT /identity/v3/projects/f2be3ec599bd4b918a05c5070afa5469/users/48592265bf6a4e619c162c1c01187858/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:42.469660 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c05f9-ff1b-40a4-a546-10aec03de3c3 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.508202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9eadfe-fca8-408c-bf8b-fbdc4cf664cd admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.532089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c05f9-ff1b-40a4-a546-10aec03de3c3 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.540539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d29645-bec6-4436-9416-2dbed101814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.541590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d29645-bec6-4436-9416-2dbed101814a admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.541879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d29645-bec6-4436-9416-2dbed101814a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.542386 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d29645-bec6-4436-9416-2dbed101814a admin admin] PATH_INFO: `/v3/projects/767dbd54817a4dc49f66b30f46919e54/users/2f10de3b7d6b492fb9a4aee600ae634c/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.544327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d29645-bec6-4436-9416-2dbed101814a admin admin] RBAC: Authorizing `identity:create_grant(project_id=767dbd54817a4dc49f66b30f46919e54, user_id=2f10de3b7d6b492fb9a4aee600ae634c, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.547354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d29645-bec6-4436-9416-2dbed101814a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.567781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 910/1870] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:42 2022] PUT /identity/v3/projects/767dbd54817a4dc49f66b30f46919e54/users/2f10de3b7d6b492fb9a4aee600ae634c/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:42.567781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d557d-75f7-4ee2-86bb-ca22d5338682 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.567781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d557d-75f7-4ee2-86bb-ca22d5338682 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.567781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d557d-75f7-4ee2-86bb-ca22d5338682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.590829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd52bc3-d2bc-4b70-8a8b-5dbec51d58a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.591787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd52bc3-d2bc-4b70-8a8b-5dbec51d58a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.591902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6a2d557d-75f7-4ee2-86bb-ca22d5338682 None None] MFA Rules not processed for user `d2ba08576f6a45959e509152eb47ebd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:42.592314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd52bc3-d2bc-4b70-8a8b-5dbec51d58a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.592640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd52bc3-d2bc-4b70-8a8b-5dbec51d58a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.593384 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd52bc3-d2bc-4b70-8a8b-5dbec51d58a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.594284 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6a2d557d-75f7-4ee2-86bb-ca22d5338682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:42.595176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd52bc3-d2bc-4b70-8a8b-5dbec51d58a7 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.612513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 961/1871] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:42.612513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c4f9-924f-4c96-ae8f-ca9b05612ae0 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.612513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c4f9-924f-4c96-ae8f-ca9b05612ae0 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.612513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236c4f9-924f-4c96-ae8f-ca9b05612ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.644095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-c236c4f9-924f-4c96-ae8f-ca9b05612ae0 None None] MFA Rules not processed for user `48592265bf6a4e619c162c1c01187858`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:42.646077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c236c4f9-924f-4c96-ae8f-ca9b05612ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:42.689387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 911/1872] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:42.691989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966478-f774-43c2-b359-dc61c2f459a8 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.692622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966478-f774-43c2-b359-dc61c2f459a8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.693091 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966478-f774-43c2-b359-dc61c2f459a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.732044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 962/1873] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:42.733478 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236c4f9-924f-4c96-ae8f-ca9b05612ae0 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.737806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-dd966478-f774-43c2-b359-dc61c2f459a8 None None] MFA Rules not processed for user `2f10de3b7d6b492fb9a4aee600ae634c`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:42.739150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dd966478-f774-43c2-b359-dc61c2f459a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:42.821776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236c4f9-924f-4c96-ae8f-ca9b05612ae0 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.825865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 912/1874] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:42.826774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966478-f774-43c2-b359-dc61c2f459a8 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.830358 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dd966478-f774-43c2-b359-dc61c2f459a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:42.837376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775e9d6-7063-4d81-99a3-f3d5f9277efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.838096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775e9d6-7063-4d81-99a3-f3d5f9277efb admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.838644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775e9d6-7063-4d81-99a3-f3d5f9277efb admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.838928 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775e9d6-7063-4d81-99a3-f3d5f9277efb admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.839659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775e9d6-7063-4d81-99a3-f3d5f9277efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.841250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775e9d6-7063-4d81-99a3-f3d5f9277efb admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.857074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 963/1875] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:42.857074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775e9d6-7063-4d81-99a3-f3d5f9277efb admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.867396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775e9d6-7063-4d81-99a3-f3d5f9277efb admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.872754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3802a-6ae3-4936-aeeb-a737b3a46d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.873572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3802a-6ae3-4936-aeeb-a737b3a46d67 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.874031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3802a-6ae3-4936-aeeb-a737b3a46d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.874490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3802a-6ae3-4936-aeeb-a737b3a46d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.875338 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3802a-6ae3-4936-aeeb-a737b3a46d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.877368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3802a-6ae3-4936-aeeb-a737b3a46d67 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.902426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966478-f774-43c2-b359-dc61c2f459a8 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.906252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa75c4c-db22-457c-a004-82f0ff3a0ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.906902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa75c4c-db22-457c-a004-82f0ff3a0ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.907185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa75c4c-db22-457c-a004-82f0ff3a0ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.907463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa75c4c-db22-457c-a004-82f0ff3a0ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.917846 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa75c4c-db22-457c-a004-82f0ff3a0ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.919347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa75c4c-db22-457c-a004-82f0ff3a0ec7 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.930222 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 913/1876] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:42.931064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa75c4c-db22-457c-a004-82f0ff3a0ec7 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.932490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7aa75c4c-db22-457c-a004-82f0ff3a0ec7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:42.943930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa75c4c-db22-457c-a004-82f0ff3a0ec7 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.950649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59e5d0-9d40-4da3-8169-9f1ccc6ee136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.951304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59e5d0-9d40-4da3-8169-9f1ccc6ee136 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.951588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59e5d0-9d40-4da3-8169-9f1ccc6ee136 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.951865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59e5d0-9d40-4da3-8169-9f1ccc6ee136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:42.961743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59e5d0-9d40-4da3-8169-9f1ccc6ee136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:42.963149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59e5d0-9d40-4da3-8169-9f1ccc6ee136 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:42.973674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 914/1877] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:42 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:42.974585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59e5d0-9d40-4da3-8169-9f1ccc6ee136 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:42.985029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59e5d0-9d40-4da3-8169-9f1ccc6ee136 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:42.990688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583c17a-87d5-46a8-938e-e84f68db04e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:42.991580 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583c17a-87d5-46a8-938e-e84f68db04e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:42.991863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583c17a-87d5-46a8-938e-e84f68db04e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:42.992140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583c17a-87d5-46a8-938e-e84f68db04e6 admin admin] PATH_INFO: `/v3/projects/bedc742f975b4a24bb8c3f0919084b46/users/e56e971cbd6a4acea489226136b254c2/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.008333 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583c17a-87d5-46a8-938e-e84f68db04e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bedc742f975b4a24bb8c3f0919084b46, user_id=e56e971cbd6a4acea489226136b254c2, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:43.011425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583c17a-87d5-46a8-938e-e84f68db04e6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:43.048548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 964/1878] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:42 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:43.050008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18828-2082-4113-8cba-a3a5b2e4a1ad None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.050217 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18828-2082-4113-8cba-a3a5b2e4a1ad None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.050541 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18828-2082-4113-8cba-a3a5b2e4a1ad None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.053099 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 965/1879] 10.222.0.26 () {54 vars in 921 bytes} [Mon Feb 28 21:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 21:56:43.053806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18828-2082-4113-8cba-a3a5b2e4a1ad None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:43.113780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18828-2082-4113-8cba-a3a5b2e4a1ad None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:43.118098 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d5bed-f715-4520-b4b8-2511cdf5c228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:43.118996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d5bed-f715-4520-b4b8-2511cdf5c228 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.119277 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d5bed-f715-4520-b4b8-2511cdf5c228 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.119588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d5bed-f715-4520-b4b8-2511cdf5c228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.145674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 915/1880] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:42 2022] PUT /identity/v3/projects/bedc742f975b4a24bb8c3f0919084b46/users/e56e971cbd6a4acea489226136b254c2/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:43.146706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583c17a-87d5-46a8-938e-e84f68db04e6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:43.191049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d5bed-f715-4520-b4b8-2511cdf5c228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:43.193111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d5bed-f715-4520-b4b8-2511cdf5c228 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:43.205117 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 966/1881] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:43.206568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfddc17-1bfb-4494-a8e5-42aa10d8bc3f None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.207694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfddc17-1bfb-4494-a8e5-42aa10d8bc3f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.208071 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfddc17-1bfb-4494-a8e5-42aa10d8bc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.225476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583c17a-87d5-46a8-938e-e84f68db04e6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:43.228436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-fbfddc17-1bfb-4494-a8e5-42aa10d8bc3f None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:43.229857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fbfddc17-1bfb-4494-a8e5-42aa10d8bc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:43.231370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae4ba-2b18-46a3-a3c7-82bafdb289d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:43.232291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae4ba-2b18-46a3-a3c7-82bafdb289d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.233047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae4ba-2b18-46a3-a3c7-82bafdb289d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.233329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae4ba-2b18-46a3-a3c7-82bafdb289d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.234335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dae4ba-2b18-46a3-a3c7-82bafdb289d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:43.236544 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dae4ba-2b18-46a3-a3c7-82bafdb289d4 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:43.308838 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 967/1882] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Feb 28 21:56:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:43.310667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b11af2-442c-48b9-aa93-0e372c974d89 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.311051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b11af2-442c-48b9-aa93-0e372c974d89 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.311397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b11af2-442c-48b9-aa93-0e372c974d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.336222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-50b11af2-442c-48b9-aa93-0e372c974d89 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:43.337453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-50b11af2-442c-48b9-aa93-0e372c974d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:43.345917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 968/1883] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:43.346834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b11af2-442c-48b9-aa93-0e372c974d89 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:43.348687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-50b11af2-442c-48b9-aa93-0e372c974d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:43.376096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b11af2-442c-48b9-aa93-0e372c974d89 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:43.376831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 916/1884] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:43 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:43.377904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae4ba-2b18-46a3-a3c7-82bafdb289d4 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:43.380505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-70dae4ba-2b18-46a3-a3c7-82bafdb289d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:43.382896 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de132958-db5e-4e9f-9717-b634203f08de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:43.383554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de132958-db5e-4e9f-9717-b634203f08de service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.383836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de132958-db5e-4e9f-9717-b634203f08de service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.384109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de132958-db5e-4e9f-9717-b634203f08de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.404251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de132958-db5e-4e9f-9717-b634203f08de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:43.405867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de132958-db5e-4e9f-9717-b634203f08de service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:43.429445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 969/1885] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:43.429445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de132958-db5e-4e9f-9717-b634203f08de service nova] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:43.458986 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de132958-db5e-4e9f-9717-b634203f08de service nova] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:43.465871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c21b-b874-4d35-a12f-51f1dcd219d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:43.466743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c21b-b874-4d35-a12f-51f1dcd219d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.467090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c21b-b874-4d35-a12f-51f1dcd219d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.467385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c21b-b874-4d35-a12f-51f1dcd219d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.468215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9c21b-b874-4d35-a12f-51f1dcd219d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:43.472300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae4ba-2b18-46a3-a3c7-82bafdb289d4 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:43.472464 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9c21b-b874-4d35-a12f-51f1dcd219d6 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:43.477471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14cf48-3765-4c05-a4e1-fa811363f4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:43.478346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14cf48-3765-4c05-a4e1-fa811363f4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.478697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14cf48-3765-4c05-a4e1-fa811363f4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.479084 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14cf48-3765-4c05-a4e1-fa811363f4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.493122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14cf48-3765-4c05-a4e1-fa811363f4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:43.495178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14cf48-3765-4c05-a4e1-fa811363f4e6 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:43.502527 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 970/1886] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:43.503178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c21b-b874-4d35-a12f-51f1dcd219d6 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:43.509943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 917/1887] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:43.537763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c21b-b874-4d35-a12f-51f1dcd219d6 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:43.548664 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e4a33-1dfa-44a1-b44a-04c2f27e90ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:43.549730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e4a33-1dfa-44a1-b44a-04c2f27e90ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.550253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e4a33-1dfa-44a1-b44a-04c2f27e90ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.551355 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e4a33-1dfa-44a1-b44a-04c2f27e90ad admin admin] PATH_INFO: `/v3/projects/d87e73d417cb4758a0416ae5a9644f2f/users/9aa4daa586e145098bb65b1fa6837d80/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.559221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14cf48-3765-4c05-a4e1-fa811363f4e6 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:43.570050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e4a33-1dfa-44a1-b44a-04c2f27e90ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87e73d417cb4758a0416ae5a9644f2f, user_id=9aa4daa586e145098bb65b1fa6837d80, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:43.573906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e4a33-1dfa-44a1-b44a-04c2f27e90ad admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:43.627496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14cf48-3765-4c05-a4e1-fa811363f4e6 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:43.631677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140c084-c0e1-46ae-b5b7-b15fc9bf0d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:43.632363 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140c084-c0e1-46ae-b5b7-b15fc9bf0d86 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.632640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140c084-c0e1-46ae-b5b7-b15fc9bf0d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.632913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140c084-c0e1-46ae-b5b7-b15fc9bf0d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.716940 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140c084-c0e1-46ae-b5b7-b15fc9bf0d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:43.718641 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140c084-c0e1-46ae-b5b7-b15fc9bf0d86 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:43.729632 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 918/1888] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:43.729823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 971/1889] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:43 2022] PUT /identity/v3/projects/d87e73d417cb4758a0416ae5a9644f2f/users/9aa4daa586e145098bb65b1fa6837d80/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:43.734996 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140c084-c0e1-46ae-b5b7-b15fc9bf0d86 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:43.747204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140c084-c0e1-46ae-b5b7-b15fc9bf0d86 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:43.831784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30db88-08b2-4f63-bc8e-1c47feba67de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:43.833843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30db88-08b2-4f63-bc8e-1c47feba67de admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.834078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30db88-08b2-4f63-bc8e-1c47feba67de admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.834367 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30db88-08b2-4f63-bc8e-1c47feba67de admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.835138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30db88-08b2-4f63-bc8e-1c47feba67de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:43.839325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30db88-08b2-4f63-bc8e-1c47feba67de admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:43.870420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 919/1890] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:43.872462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e4a33-1dfa-44a1-b44a-04c2f27e90ad admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:43.892932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e4a33-1dfa-44a1-b44a-04c2f27e90ad admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:43.900203 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa2283-6121-4376-b75a-8bd1ddc2c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:43.902983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa2283-6121-4376-b75a-8bd1ddc2c677 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.903689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa2283-6121-4376-b75a-8bd1ddc2c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.904682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa2283-6121-4376-b75a-8bd1ddc2c677 admin admin] PATH_INFO: `/v3/projects/d87e73d417cb4758a0416ae5a9644f2f/users/9aa4daa586e145098bb65b1fa6837d80/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:43.908250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa2283-6121-4376-b75a-8bd1ddc2c677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d87e73d417cb4758a0416ae5a9644f2f, user_id=9aa4daa586e145098bb65b1fa6837d80, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:43.916014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa2283-6121-4376-b75a-8bd1ddc2c677 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:43.956660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 972/1891] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:43 2022] PUT /identity/v3/projects/d87e73d417cb4758a0416ae5a9644f2f/users/9aa4daa586e145098bb65b1fa6837d80/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:43.968677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab581a0-1507-4e43-8b53-f62ac3d5a66b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:43.969022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab581a0-1507-4e43-8b53-f62ac3d5a66b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:43.969268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab581a0-1507-4e43-8b53-f62ac3d5a66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:44.000494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-cab581a0-1507-4e43-8b53-f62ac3d5a66b None None] MFA Rules not processed for user `9aa4daa586e145098bb65b1fa6837d80`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:44.002172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-cab581a0-1507-4e43-8b53-f62ac3d5a66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:44.080987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 920/1892] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:44.408243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa2283-6121-4376-b75a-8bd1ddc2c677 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:44.495072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa2283-6121-4376-b75a-8bd1ddc2c677 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:44.498717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30acf55-7659-4a09-a4cd-5bd7f71f05be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:44.499361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30acf55-7659-4a09-a4cd-5bd7f71f05be service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:44.499940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30acf55-7659-4a09-a4cd-5bd7f71f05be service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:44.499940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30acf55-7659-4a09-a4cd-5bd7f71f05be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:44.509486 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30acf55-7659-4a09-a4cd-5bd7f71f05be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:44.510958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30acf55-7659-4a09-a4cd-5bd7f71f05be service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:44.520663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 973/1893] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:45.455032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee691ee-228d-4db1-8387-d061186c8e19 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:45.455522 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee691ee-228d-4db1-8387-d061186c8e19 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:45.455715 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee691ee-228d-4db1-8387-d061186c8e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:45.492795 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-7ee691ee-228d-4db1-8387-d061186c8e19 None None] MFA Rules not processed for user `e56e971cbd6a4acea489226136b254c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:45.494049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7ee691ee-228d-4db1-8387-d061186c8e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:45.561758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 921/1894] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:45.566325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30acf55-7659-4a09-a4cd-5bd7f71f05be service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:45.634718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30acf55-7659-4a09-a4cd-5bd7f71f05be service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:45.639693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471987f5-090b-48cf-b1c6-b9da75b21a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:45.640588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471987f5-090b-48cf-b1c6-b9da75b21a95 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:45.640872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471987f5-090b-48cf-b1c6-b9da75b21a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:45.641145 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471987f5-090b-48cf-b1c6-b9da75b21a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:45.641845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471987f5-090b-48cf-b1c6-b9da75b21a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:45.643779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471987f5-090b-48cf-b1c6-b9da75b21a95 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:45.797300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 974/1895] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:45 2022] POST /identity/v3/projects => generated 405 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:45.798047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee691ee-228d-4db1-8387-d061186c8e19 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:45.818383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee691ee-228d-4db1-8387-d061186c8e19 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:45.910934 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fda38-369f-421e-80d3-ed5a475ed380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:45.911688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fda38-369f-421e-80d3-ed5a475ed380 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:45.911871 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fda38-369f-421e-80d3-ed5a475ed380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:45.912142 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fda38-369f-421e-80d3-ed5a475ed380 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:45.912820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fda38-369f-421e-80d3-ed5a475ed380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:45.915400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fda38-369f-421e-80d3-ed5a475ed380 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:45.916043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471987f5-090b-48cf-b1c6-b9da75b21a95 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:45.979996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471987f5-090b-48cf-b1c6-b9da75b21a95 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:45.984574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6a0ab-5c51-4fd3-ba95-11285114b744 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa4daa586e145098bb65b1fa6837d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd87e73d417cb4758a0416ae5a9644f2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:45.992659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6a0ab-5c51-4fd3-ba95-11285114b744 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:45.992659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6a0ab-5c51-4fd3-ba95-11285114b744 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:45.992659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6a0ab-5c51-4fd3-ba95-11285114b744 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:45.992659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6a0ab-5c51-4fd3-ba95-11285114b744 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:45.992659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6a0ab-5c51-4fd3-ba95-11285114b744 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:45.993048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6a0ab-5c51-4fd3-ba95-11285114b744 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:46.003209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 975/1896] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:56:46.008932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6a0ab-5c51-4fd3-ba95-11285114b744 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:46.020922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6a0ab-5c51-4fd3-ba95-11285114b744 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:46.027112 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9f556-23fe-45a1-b4b3-f3ac3375fcd7 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa4daa586e145098bb65b1fa6837d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd87e73d417cb4758a0416ae5a9644f2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:46.027774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9f556-23fe-45a1-b4b3-f3ac3375fcd7 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:46.028082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9f556-23fe-45a1-b4b3-f3ac3375fcd7 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:46.028353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9f556-23fe-45a1-b4b3-f3ac3375fcd7 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:46.029046 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9f556-23fe-45a1-b4b3-f3ac3375fcd7 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:46.031123 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9f556-23fe-45a1-b4b3-f3ac3375fcd7 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:46.197909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 922/1897] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:45 2022] POST /identity/v3/users => generated 309 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:46.201739 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fda38-369f-421e-80d3-ed5a475ed380 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:46.217273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fda38-369f-421e-80d3-ed5a475ed380 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:46.223146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ec188-1277-4134-84b7-e0d054856a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:46.224155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ec188-1277-4134-84b7-e0d054856a8c admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:46.224481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ec188-1277-4134-84b7-e0d054856a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:46.224805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ec188-1277-4134-84b7-e0d054856a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:46.239398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ec188-1277-4134-84b7-e0d054856a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:46.247590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ec188-1277-4134-84b7-e0d054856a8c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:46.250132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 976/1898] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:46 2022] POST /identity/v3/projects => generated 354 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:46.255674 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9f556-23fe-45a1-b4b3-f3ac3375fcd7 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:46.259648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 923/1899] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:46.263538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ec188-1277-4134-84b7-e0d054856a8c admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:46.275497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ec188-1277-4134-84b7-e0d054856a8c admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:46.341638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9f556-23fe-45a1-b4b3-f3ac3375fcd7 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:46.342961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f2f2e-b4e3-4ccc-9ec1-690f2448f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:46.344122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2f2e-b4e3-4ccc-9ec1-690f2448f5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:46.344557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2f2e-b4e3-4ccc-9ec1-690f2448f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:46.345000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2f2e-b4e3-4ccc-9ec1-690f2448f5fe admin admin] PATH_INFO: `/v3/projects/1fb9c4a987c7497a8df7e43a09e28881/users/69442f8cf1904c69a9b9e80bfcc90291/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:46.347001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3be78-a147-42f3-b646-ed53710ee426 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa4daa586e145098bb65b1fa6837d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd87e73d417cb4758a0416ae5a9644f2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:46.348784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3be78-a147-42f3-b646-ed53710ee426 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:46.349141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3be78-a147-42f3-b646-ed53710ee426 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:46.349482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3be78-a147-42f3-b646-ed53710ee426 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:46.354157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3be78-a147-42f3-b646-ed53710ee426 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:46.354157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3be78-a147-42f3-b646-ed53710ee426 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:46.354157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3be78-a147-42f3-b646-ed53710ee426 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:46.364402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f2f2e-b4e3-4ccc-9ec1-690f2448f5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb9c4a987c7497a8df7e43a09e28881, user_id=69442f8cf1904c69a9b9e80bfcc90291, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:46.366350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 977/1900] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:56:46.367323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f2f2e-b4e3-4ccc-9ec1-690f2448f5fe admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:46.527701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 924/1901] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:46 2022] PUT /identity/v3/projects/1fb9c4a987c7497a8df7e43a09e28881/users/69442f8cf1904c69a9b9e80bfcc90291/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:46.531706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3be78-a147-42f3-b646-ed53710ee426 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:46.543310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3be78-a147-42f3-b646-ed53710ee426 tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:46.601135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5d784-cc20-4d94-8e97-cfe465371fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:46.601837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5d784-cc20-4d94-8e97-cfe465371fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:46.602101 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5d784-cc20-4d94-8e97-cfe465371fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:46.602372 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5d784-cc20-4d94-8e97-cfe465371fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:46.603117 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5d784-cc20-4d94-8e97-cfe465371fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:46.604697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5d784-cc20-4d94-8e97-cfe465371fb0 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:46.629703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 978/1902] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:46.633239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f2f2e-b4e3-4ccc-9ec1-690f2448f5fe admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:46.646274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f2f2e-b4e3-4ccc-9ec1-690f2448f5fe admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:46.672058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd9242-fa51-405f-930d-fb52437ca37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:46.674499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5d784-cc20-4d94-8e97-cfe465371fb0 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:46.674804 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd9242-fa51-405f-930d-fb52437ca37f admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:46.675322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd9242-fa51-405f-930d-fb52437ca37f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:46.677477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd9242-fa51-405f-930d-fb52437ca37f admin admin] PATH_INFO: `/v3/projects/1fb9c4a987c7497a8df7e43a09e28881/users/69442f8cf1904c69a9b9e80bfcc90291/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:46.684425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd9242-fa51-405f-930d-fb52437ca37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb9c4a987c7497a8df7e43a09e28881, user_id=69442f8cf1904c69a9b9e80bfcc90291, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:46.690721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd9242-fa51-405f-930d-fb52437ca37f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:46.718779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 925/1903] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:46 2022] PUT /identity/v3/projects/1fb9c4a987c7497a8df7e43a09e28881/users/69442f8cf1904c69a9b9e80bfcc90291/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:46.768883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5d784-cc20-4d94-8e97-cfe465371fb0 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:46.824589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa4daa586e145098bb65b1fa6837d80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd87e73d417cb4758a0416ae5a9644f2f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:46.825580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:46.825932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:46.826243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] PATH_INFO: `/v3/projects/bde47aa4d47145c19e385c0203ce95c9` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:46.827459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bde47aa4d47145c19e385c0203ce95c9)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:46.830060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:47.007247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde47aa4d47145c19e385c0203ce95c9', 'request_id': 'req-d5b12a2d-e4a0-46eb-8885-0441bb26432d'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:47.013413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde47aa4d47145c19e385c0203ce95c9', 'request_id': 'req-d5b12a2d-e4a0-46eb-8885-0441bb26432d'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:47.132718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde47aa4d47145c19e385c0203ce95c9', 'request_id': 'req-d5b12a2d-e4a0-46eb-8885-0441bb26432d'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:47.147365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] The token cache is being invalidate because project bde47aa4d47145c19e385c0203ce95c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:47.147737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:47.148415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:47.150541 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 979/1904] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:46 2022] DELETE /identity/v3/projects/bde47aa4d47145c19e385c0203ce95c9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:47.739021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd9242-fa51-405f-930d-fb52437ca37f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:47.740929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-55fd9242-fa51-405f-930d-fb52437ca37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:47.821511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd9242-fa51-405f-930d-fb52437ca37f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:47.879667 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:47.880642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:47.880924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:47.881200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] PATH_INFO: `/v3/users/fed43a9cd1544c5fb995c7e28cba4d7c` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:47.882837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed43a9cd1544c5fb995c7e28cba4d7c)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:47.886281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:47.922128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:47.923567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:47.938743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b12a2d-e4a0-46eb-8885-0441bb26432d tempest-VolumeQuotaClassesTest-1286303978 tempest-VolumeQuotaClassesTest-1286303978-project-admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:47.944153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:47.945017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:47.945296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:47.945568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] PATH_INFO: `/v3/users/48592265bf6a4e619c162c1c01187858` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:47.946805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48592265bf6a4e619c162c1c01187858)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:47.948763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:48.098516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed43a9cd1544c5fb995c7e28cba4d7c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:48.099109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed43a9cd1544c5fb995c7e28cba4d7c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:48.212728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed43a9cd1544c5fb995c7e28cba4d7c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:48.220396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed43a9cd1544c5fb995c7e28cba4d7c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:48.233151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c4b46d46-c87d-44d0-8a11-9ae8cf834fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed43a9cd1544c5fb995c7e28cba4d7c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:48.239597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 926/1905] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:47 2022] DELETE /identity/v3/users/fed43a9cd1544c5fb995c7e28cba4d7c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:48.246218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4ad9f-7c9c-4c91-a757-a49d81d9da5e None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:48.246508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4ad9f-7c9c-4c91-a757-a49d81d9da5e None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:48.246789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4ad9f-7c9c-4c91-a757-a49d81d9da5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:48.265124 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-b7a4ad9f-7c9c-4c91-a757-a49d81d9da5e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:48.266366 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b7a4ad9f-7c9c-4c91-a757-a49d81d9da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:48.324704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48592265bf6a4e619c162c1c01187858'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:48.327446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 927/1906] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:48.338092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4ad9f-7c9c-4c91-a757-a49d81d9da5e None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:48.338867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48592265bf6a4e619c162c1c01187858'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:48.340138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b7a4ad9f-7c9c-4c91-a757-a49d81d9da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:48.398149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4ad9f-7c9c-4c91-a757-a49d81d9da5e None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:48.401947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b402e40-39ef-4f1c-ba07-8320d95057c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:48.402636 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b402e40-39ef-4f1c-ba07-8320d95057c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:48.402918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b402e40-39ef-4f1c-ba07-8320d95057c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:48.403195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b402e40-39ef-4f1c-ba07-8320d95057c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:48.415697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b402e40-39ef-4f1c-ba07-8320d95057c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:48.415697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b402e40-39ef-4f1c-ba07-8320d95057c5 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:48.425197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 928/1907] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:56:48.427380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06044f6-8214-4f66-9f0b-623d90b1d9ce None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:48.427670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06044f6-8214-4f66-9f0b-623d90b1d9ce None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:48.427944 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06044f6-8214-4f66-9f0b-623d90b1d9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:48.435687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48592265bf6a4e619c162c1c01187858'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:48.454037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48592265bf6a4e619c162c1c01187858'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:48.455096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f9e9d150-1e09-42d4-96c3-c9f96bad1b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48592265bf6a4e619c162c1c01187858'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:48.456758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-e06044f6-8214-4f66-9f0b-623d90b1d9ce None None] MFA Rules not processed for user `69442f8cf1904c69a9b9e80bfcc90291`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:48.457976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e06044f6-8214-4f66-9f0b-623d90b1d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:48.467003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 980/1908] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:47 2022] DELETE /identity/v3/users/48592265bf6a4e619c162c1c01187858 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:48.471367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d752e3d-d6db-4a13-b3c8-22492bfbef7b None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:48.471874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d752e3d-d6db-4a13-b3c8-22492bfbef7b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:48.473253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d752e3d-d6db-4a13-b3c8-22492bfbef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:48.494957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-3d752e3d-d6db-4a13-b3c8-22492bfbef7b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:48.497309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3d752e3d-d6db-4a13-b3c8-22492bfbef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:48.547362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 929/1909] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:48.562772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 981/1910] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:48.581657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06044f6-8214-4f66-9f0b-623d90b1d9ce None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:48.583540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e06044f6-8214-4f66-9f0b-623d90b1d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:48.597074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06044f6-8214-4f66-9f0b-623d90b1d9ce None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:48.647368 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea339a-760f-4061-a3d8-0840d022b320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:48.648006 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea339a-760f-4061-a3d8-0840d022b320 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:48.648283 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea339a-760f-4061-a3d8-0840d022b320 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:48.648554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea339a-760f-4061-a3d8-0840d022b320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:48.657922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea339a-760f-4061-a3d8-0840d022b320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:48.659404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea339a-760f-4061-a3d8-0840d022b320 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:48.669097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 930/1911] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:49.026307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d752e3d-d6db-4a13-b3c8-22492bfbef7b None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:49.036021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3d752e3d-d6db-4a13-b3c8-22492bfbef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:49.041440 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d752e3d-d6db-4a13-b3c8-22492bfbef7b None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:49.046556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:49.047563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:49.047920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:49.048287 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] PATH_INFO: `/v3/projects/ab5b075e9763485e9c18123f2eaa4ff8` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:49.049706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5b075e9763485e9c18123f2eaa4ff8)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:49.052352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:49.177528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5b075e9763485e9c18123f2eaa4ff8', 'request_id': 'req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.185201 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5b075e9763485e9c18123f2eaa4ff8', 'request_id': 'req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.253078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5b075e9763485e9c18123f2eaa4ff8', 'request_id': 'req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.265967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] The token cache is being invalidate because project ab5b075e9763485e9c18123f2eaa4ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:49.266294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.266953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.268513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 982/1912] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:49 2022] DELETE /identity/v3/projects/ab5b075e9763485e9c18123f2eaa4ff8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:49.274273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea339a-760f-4061-a3d8-0840d022b320 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:49.284397 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea339a-760f-4061-a3d8-0840d022b320 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:49.369685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:49.370849 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:49.371273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:49.371690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] PATH_INFO: `/v3/users/d2ba08576f6a45959e509152eb47ebd2` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:49.373047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ba08576f6a45959e509152eb47ebd2)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:49.375796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:49.586148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:49.587673 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:49.607755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fefa1b-0df4-48dc-b8b5-7a5505e663ba admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:49.612702 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:49.614271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:49.614737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:49.615085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] PATH_INFO: `/v3/projects/f2be3ec599bd4b918a05c5070afa5469` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:49.616432 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2be3ec599bd4b918a05c5070afa5469)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:49.618862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:49.635233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ba08576f6a45959e509152eb47ebd2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.635902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ba08576f6a45959e509152eb47ebd2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.761050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ba08576f6a45959e509152eb47ebd2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.768952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ba08576f6a45959e509152eb47ebd2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.780962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ba08576f6a45959e509152eb47ebd2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.789508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 931/1913] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:49 2022] DELETE /identity/v3/users/d2ba08576f6a45959e509152eb47ebd2 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:49.798812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2be3ec599bd4b918a05c5070afa5469', 'request_id': 'req-5ef332dd-9b7b-491e-8ad1-58488bf25517'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.805664 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2be3ec599bd4b918a05c5070afa5469', 'request_id': 'req-5ef332dd-9b7b-491e-8ad1-58488bf25517'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.901721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2be3ec599bd4b918a05c5070afa5469', 'request_id': 'req-5ef332dd-9b7b-491e-8ad1-58488bf25517'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.912050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] The token cache is being invalidate because project f2be3ec599bd4b918a05c5070afa5469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:49.912050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.913134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:49.914784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 983/1914] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:49 2022] DELETE /identity/v3/projects/f2be3ec599bd4b918a05c5070afa5469 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:49.919109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:49.920775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:49.991020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514396f3-be50-4406-a4f9-41df5762d820 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:49.995652 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:49.996554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:49.996831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:49.997100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] PATH_INFO: `/v3/users/9aa4daa586e145098bb65b1fa6837d80` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:49.998316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aa4daa586e145098bb65b1fa6837d80)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:50.000248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:50.608330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:50.612133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:50.640825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aa4daa586e145098bb65b1fa6837d80'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:50.640825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aa4daa586e145098bb65b1fa6837d80'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:50.691558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef332dd-9b7b-491e-8ad1-58488bf25517 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:50.696210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:50.697146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:50.697421 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:50.697690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] PATH_INFO: `/v3/projects/4f9e39aa611a43cc80191aa798f3a8e4` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:50.698911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9e39aa611a43cc80191aa798f3a8e4)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:50.700796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:50.750475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aa4daa586e145098bb65b1fa6837d80'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:50.757529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aa4daa586e145098bb65b1fa6837d80'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:50.768901 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aa4daa586e145098bb65b1fa6837d80'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:50.775396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 932/1915] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:49 2022] DELETE /identity/v3/users/9aa4daa586e145098bb65b1fa6837d80 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:50.776253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:50.777706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:50.841543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e07e5f-bff1-46bb-9fb0-4d73c9b1f438 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:50.846220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:50.847120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:50.848180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:50.848473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] PATH_INFO: `/v3/users/e56e971cbd6a4acea489226136b254c2` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:50.849662 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56e971cbd6a4acea489226136b254c2)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:50.851639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:50.921200 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9e39aa611a43cc80191aa798f3a8e4', 'request_id': 'req-5223c992-9a42-49ea-b7f6-4646647240b9'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:50.927416 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9e39aa611a43cc80191aa798f3a8e4', 'request_id': 'req-5223c992-9a42-49ea-b7f6-4646647240b9'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.087605 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9e39aa611a43cc80191aa798f3a8e4', 'request_id': 'req-5223c992-9a42-49ea-b7f6-4646647240b9'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.110164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] The token cache is being invalidate because project 4f9e39aa611a43cc80191aa798f3a8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:51.110467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.111202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5223c992-9a42-49ea-b7f6-4646647240b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.112892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 984/1916] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:50 2022] DELETE /identity/v3/projects/4f9e39aa611a43cc80191aa798f3a8e4 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:51.122348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbff77-0678-4947-86b6-1731af6dc301 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.122636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbff77-0678-4947-86b6-1731af6dc301 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.122919 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbff77-0678-4947-86b6-1731af6dc301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.144005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-58cbff77-0678-4947-86b6-1731af6dc301 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:51.146199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-58cbff77-0678-4947-86b6-1731af6dc301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:51.168033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56e971cbd6a4acea489226136b254c2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.169029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56e971cbd6a4acea489226136b254c2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.212161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 985/1917] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:51.220510 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea534b-43f6-4698-b813-2f33bc5854a7 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.220806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea534b-43f6-4698-b813-2f33bc5854a7 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.221086 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea534b-43f6-4698-b813-2f33bc5854a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.239899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-39ea534b-43f6-4698-b813-2f33bc5854a7 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:51.241022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-39ea534b-43f6-4698-b813-2f33bc5854a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:51.248964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 986/1918] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:51.253025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea534b-43f6-4698-b813-2f33bc5854a7 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:51.262359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea534b-43f6-4698-b813-2f33bc5854a7 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:51.270246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7508a-9e33-4fdb-b32e-a85395ad7745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:51.270910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7508a-9e33-4fdb-b32e-a85395ad7745 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.271207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7508a-9e33-4fdb-b32e-a85395ad7745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.271556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7508a-9e33-4fdb-b32e-a85395ad7745 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.272191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7508a-9e33-4fdb-b32e-a85395ad7745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:51.272498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7508a-9e33-4fdb-b32e-a85395ad7745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:51.274181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7508a-9e33-4fdb-b32e-a85395ad7745 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:51.281471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56e971cbd6a4acea489226136b254c2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.288286 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 987/1919] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:56:51.292279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56e971cbd6a4acea489226136b254c2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.292536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7508a-9e33-4fdb-b32e-a85395ad7745 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:51.303400 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7508a-9e33-4fdb-b32e-a85395ad7745 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:51.306113 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56e971cbd6a4acea489226136b254c2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.308257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4b5c-8a63-4988-a4ea-a193987a377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:51.308941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4b5c-8a63-4988-a4ea-a193987a377d admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.309224 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4b5c-8a63-4988-a4ea-a193987a377d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.309501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4b5c-8a63-4988-a4ea-a193987a377d admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.310215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e4b5c-8a63-4988-a4ea-a193987a377d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:51.312163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e4b5c-8a63-4988-a4ea-a193987a377d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:51.312562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 933/1920] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:50 2022] DELETE /identity/v3/users/e56e971cbd6a4acea489226136b254c2 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:51.334330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:51.335869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:51.416246 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701a8bc-d2b1-4861-b6de-4139c78edec1 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:51.422042 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:51.422915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.423192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.423477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] PATH_INFO: `/v3/projects/d87e73d417cb4758a0416ae5a9644f2f` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.424662 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d87e73d417cb4758a0416ae5a9644f2f)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:51.427582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:51.427729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 988/1921] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:51 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:51.431425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4b5c-8a63-4988-a4ea-a193987a377d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:51.433205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e02e4b5c-8a63-4988-a4ea-a193987a377d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:51.495873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4b5c-8a63-4988-a4ea-a193987a377d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:51.500454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e5f9-e150-493e-a389-9a0776e7c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:51.501135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e5f9-e150-493e-a389-9a0776e7c05a admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.501390 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e5f9-e150-493e-a389-9a0776e7c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.501662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37e5f9-e150-493e-a389-9a0776e7c05a admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.502406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37e5f9-e150-493e-a389-9a0776e7c05a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:51.504594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37e5f9-e150-493e-a389-9a0776e7c05a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:51.539340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd87e73d417cb4758a0416ae5a9644f2f', 'request_id': 'req-a69f4075-7aa3-4816-9c24-d0b66b320cb9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.545478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd87e73d417cb4758a0416ae5a9644f2f', 'request_id': 'req-a69f4075-7aa3-4816-9c24-d0b66b320cb9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.551145 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd87e73d417cb4758a0416ae5a9644f2f', 'request_id': 'req-a69f4075-7aa3-4816-9c24-d0b66b320cb9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.621785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 989/1922] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:51 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:51.623371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e5f9-e150-493e-a389-9a0776e7c05a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:51.625404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3d37e5f9-e150-493e-a389-9a0776e7c05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:51.640274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37e5f9-e150-493e-a389-9a0776e7c05a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:51.647989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] The token cache is being invalidate because project d87e73d417cb4758a0416ae5a9644f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:51.648502 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.649068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.650905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 934/1923] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:51 2022] DELETE /identity/v3/projects/d87e73d417cb4758a0416ae5a9644f2f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:51.651797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:51.653126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:51.708982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:51.710015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.710492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.711318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] PATH_INFO: `/v3/projects/bedc742f975b4a24bb8c3f0919084b46` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.712859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bedc742f975b4a24bb8c3f0919084b46)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:51.715576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:51.720402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f4075-7aa3-4816-9c24-d0b66b320cb9 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:51.727376 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ce875-fd64-4c10-8846-a5d1ca3892c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:51.728238 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ce875-fd64-4c10-8846-a5d1ca3892c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.728524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ce875-fd64-4c10-8846-a5d1ca3892c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.728797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ce875-fd64-4c10-8846-a5d1ca3892c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.729534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ce875-fd64-4c10-8846-a5d1ca3892c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:51.731386 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ce875-fd64-4c10-8846-a5d1ca3892c7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:51.742749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 935/1924] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:51.744235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b72edc-c6a2-483f-a56e-8db536a90ef1 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.744527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b72edc-c6a2-483f-a56e-8db536a90ef1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.744805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b72edc-c6a2-483f-a56e-8db536a90ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.763096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-41b72edc-c6a2-483f-a56e-8db536a90ef1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:51.764287 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-41b72edc-c6a2-483f-a56e-8db536a90ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:51.773167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 936/1925] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:51.773962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b72edc-c6a2-483f-a56e-8db536a90ef1 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:51.783254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b72edc-c6a2-483f-a56e-8db536a90ef1 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:51.789293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b39e89-8ad9-4382-9d0a-110d04c30cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:51.789950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b39e89-8ad9-4382-9d0a-110d04c30cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.790263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b39e89-8ad9-4382-9d0a-110d04c30cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.792414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b39e89-8ad9-4382-9d0a-110d04c30cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.792414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b39e89-8ad9-4382-9d0a-110d04c30cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:51.793129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b39e89-8ad9-4382-9d0a-110d04c30cb7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:51.803047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 937/1926] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:51.804379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb7950-3c18-4158-80ea-8ebb9460bec6 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.804670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb7950-3c18-4158-80ea-8ebb9460bec6 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.804945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb7950-3c18-4158-80ea-8ebb9460bec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.839459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bedc742f975b4a24bb8c3f0919084b46', 'request_id': 'req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.844225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-cfeb7950-3c18-4158-80ea-8ebb9460bec6 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:51.844225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-cfeb7950-3c18-4158-80ea-8ebb9460bec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:51.846670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bedc742f975b4a24bb8c3f0919084b46', 'request_id': 'req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.914458 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 938/1927] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:51.915290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb7950-3c18-4158-80ea-8ebb9460bec6 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:51.924297 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb7950-3c18-4158-80ea-8ebb9460bec6 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:51.927539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bedc742f975b4a24bb8c3f0919084b46', 'request_id': 'req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.929052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292e660-af01-45c2-b8f1-7dd57828124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:51.929938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292e660-af01-45c2-b8f1-7dd57828124a admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.930245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292e660-af01-45c2-b8f1-7dd57828124a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.930514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292e660-af01-45c2-b8f1-7dd57828124a admin admin] PATH_INFO: `/v3/projects/9a09a9a436dc486c8b8bdc80d2d655ae/users/dfbba85a69e84eafb3b17ec8721f56b2/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.943467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] The token cache is being invalidate because project bedc742f975b4a24bb8c3f0919084b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:51.943691 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.944335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:51.945962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 990/1928] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:51 2022] DELETE /identity/v3/projects/bedc742f975b4a24bb8c3f0919084b46 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:51.946705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:51.947971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:51.950318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292e660-af01-45c2-b8f1-7dd57828124a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a09a9a436dc486c8b8bdc80d2d655ae, user_id=dfbba85a69e84eafb3b17ec8721f56b2, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:51.953731 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292e660-af01-45c2-b8f1-7dd57828124a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:51.961266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89ed15-8ed9-401e-bc16-7ef01befbd0c admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:51.966546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3ca6e-a9a2-4690-b351-ad06036dcae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:51.970385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3ca6e-a9a2-4690-b351-ad06036dcae5 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:51.970385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3ca6e-a9a2-4690-b351-ad06036dcae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:51.970385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3ca6e-a9a2-4690-b351-ad06036dcae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:51.970385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3ca6e-a9a2-4690-b351-ad06036dcae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:51.970385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3ca6e-a9a2-4690-b351-ad06036dcae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:51.970779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3ca6e-a9a2-4690-b351-ad06036dcae5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:51.985703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 991/1929] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:56:51.985703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3ca6e-a9a2-4690-b351-ad06036dcae5 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:51.985703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-bac3ca6e-a9a2-4690-b351-ad06036dcae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:51.998609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3ca6e-a9a2-4690-b351-ad06036dcae5 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:52.003968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:52.004858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:52.005137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:52.005411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] PATH_INFO: `/v3/users/69442f8cf1904c69a9b9e80bfcc90291` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:52.006642 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] RBAC: Authorizing `identity:delete_user(user_id=69442f8cf1904c69a9b9e80bfcc90291)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:52.008567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:52.045010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 939/1930] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:51 2022] PUT /identity/v3/projects/9a09a9a436dc486c8b8bdc80d2d655ae/users/dfbba85a69e84eafb3b17ec8721f56b2/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:52.045010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292e660-af01-45c2-b8f1-7dd57828124a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:52.109810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292e660-af01-45c2-b8f1-7dd57828124a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:52.115247 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ccce2-fb62-4ae3-9631-813f97d14632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:52.115909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ccce2-fb62-4ae3-9631-813f97d14632 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:52.116191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ccce2-fb62-4ae3-9631-813f97d14632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:52.116491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ccce2-fb62-4ae3-9631-813f97d14632 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:52.117181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ccce2-fb62-4ae3-9631-813f97d14632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:52.119126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ccce2-fb62-4ae3-9631-813f97d14632 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:52.243505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69442f8cf1904c69a9b9e80bfcc90291'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:52.250008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69442f8cf1904c69a9b9e80bfcc90291'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:52.265538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 940/1931] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:52 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:52.267025 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d53c5-534a-44f5-8fd9-fa37888e30e2 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:52.267317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d53c5-534a-44f5-8fd9-fa37888e30e2 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:52.267680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d53c5-534a-44f5-8fd9-fa37888e30e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:52.295027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f93d53c5-534a-44f5-8fd9-fa37888e30e2 None None] MFA Rules not processed for user `dfbba85a69e84eafb3b17ec8721f56b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:52.296166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f93d53c5-534a-44f5-8fd9-fa37888e30e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:52.319049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69442f8cf1904c69a9b9e80bfcc90291'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:52.333203 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69442f8cf1904c69a9b9e80bfcc90291'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:52.333905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69442f8cf1904c69a9b9e80bfcc90291'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:52.343534 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 992/1932] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:51 2022] DELETE /identity/v3/users/69442f8cf1904c69a9b9e80bfcc90291 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:52.343534 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:52.343534 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:52.375463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 941/1933] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:52.376476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d53c5-534a-44f5-8fd9-fa37888e30e2 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:52.377961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f93d53c5-534a-44f5-8fd9-fa37888e30e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:52.434347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444750f7-9202-493b-8874-f0b3d1bb032c admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:52.439610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea7f8e-e2be-4de2-9fa8-978f066997c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:52.440357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea7f8e-e2be-4de2-9fa8-978f066997c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:52.440635 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea7f8e-e2be-4de2-9fa8-978f066997c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:52.441676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea7f8e-e2be-4de2-9fa8-978f066997c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:52.442783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea7f8e-e2be-4de2-9fa8-978f066997c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:52.444724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea7f8e-e2be-4de2-9fa8-978f066997c0 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:52.453784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d53c5-534a-44f5-8fd9-fa37888e30e2 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:52.459697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b91a80-51f5-4e65-8ca3-9cc80ad2a642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:52.460451 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b91a80-51f5-4e65-8ca3-9cc80ad2a642 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:52.460790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b91a80-51f5-4e65-8ca3-9cc80ad2a642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:52.463719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b91a80-51f5-4e65-8ca3-9cc80ad2a642 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:52.463719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b91a80-51f5-4e65-8ca3-9cc80ad2a642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:52.464205 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b91a80-51f5-4e65-8ca3-9cc80ad2a642 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:52.579077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 993/1934] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:52 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:52.588182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea7f8e-e2be-4de2-9fa8-978f066997c0 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:52.593274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea7f8e-e2be-4de2-9fa8-978f066997c0 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:52.598070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919663e-4b2f-4373-8c8b-e414c7fc5330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:52.598708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919663e-4b2f-4373-8c8b-e414c7fc5330 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:52.598992 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919663e-4b2f-4373-8c8b-e414c7fc5330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:52.599268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919663e-4b2f-4373-8c8b-e414c7fc5330 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:52.600055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919663e-4b2f-4373-8c8b-e414c7fc5330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:52.601630 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919663e-4b2f-4373-8c8b-e414c7fc5330 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:52.611520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 994/1935] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:52.616638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919663e-4b2f-4373-8c8b-e414c7fc5330 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:52.627772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919663e-4b2f-4373-8c8b-e414c7fc5330 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:52.634346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 942/1936] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:52 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:52.645922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b91a80-51f5-4e65-8ca3-9cc80ad2a642 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:52.645922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e4b91a80-51f5-4e65-8ca3-9cc80ad2a642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:52.646250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5b4bf-869c-4260-891d-f34c1eaa66ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:52.646250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5b4bf-869c-4260-891d-f34c1eaa66ec admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:52.646250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5b4bf-869c-4260-891d-f34c1eaa66ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:52.646250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5b4bf-869c-4260-891d-f34c1eaa66ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:52.646808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5b4bf-869c-4260-891d-f34c1eaa66ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:52.646808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5b4bf-869c-4260-891d-f34c1eaa66ec admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:52.666650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 995/1937] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:52.668013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5b4bf-869c-4260-891d-f34c1eaa66ec admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:52.686537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5b4bf-869c-4260-891d-f34c1eaa66ec admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:52.730049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b91a80-51f5-4e65-8ca3-9cc80ad2a642 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:52.735172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:52.736104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:52.736479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:52.736838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] PATH_INFO: `/v3/projects/1fb9c4a987c7497a8df7e43a09e28881` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:52.739021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb9c4a987c7497a8df7e43a09e28881)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:52.740684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:52.779911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3418595-0d4a-400d-8d5a-997e49567910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:52.780750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3418595-0d4a-400d-8d5a-997e49567910 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:52.781032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3418595-0d4a-400d-8d5a-997e49567910 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:52.781307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3418595-0d4a-400d-8d5a-997e49567910 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:52.782024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3418595-0d4a-400d-8d5a-997e49567910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:52.783979 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3418595-0d4a-400d-8d5a-997e49567910 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:52.883391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb9c4a987c7497a8df7e43a09e28881', 'request_id': 'req-4e6112ea-84b4-44a6-82e1-90674c123526'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:52.891122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb9c4a987c7497a8df7e43a09e28881', 'request_id': 'req-4e6112ea-84b4-44a6-82e1-90674c123526'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:52.896258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb9c4a987c7497a8df7e43a09e28881', 'request_id': 'req-4e6112ea-84b4-44a6-82e1-90674c123526'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:52.927595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 996/1938] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:52 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:52.928353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3418595-0d4a-400d-8d5a-997e49567910 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:52.949655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3418595-0d4a-400d-8d5a-997e49567910 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.004422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408969c-b527-4d01-8f13-d916e1ae478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.006627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408969c-b527-4d01-8f13-d916e1ae478f admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.006627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408969c-b527-4d01-8f13-d916e1ae478f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.006627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408969c-b527-4d01-8f13-d916e1ae478f admin admin] PATH_INFO: `/v3/projects/4ea35541895a489ea2a4d4962d9ba2f1/users/87bebd1c8b2a4e4c95e3345a3d558021/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.020976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408969c-b527-4d01-8f13-d916e1ae478f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea35541895a489ea2a4d4962d9ba2f1, user_id=87bebd1c8b2a4e4c95e3345a3d558021, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.023751 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408969c-b527-4d01-8f13-d916e1ae478f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.029976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] The token cache is being invalidate because project 1fb9c4a987c7497a8df7e43a09e28881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:53.030300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:53.031114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:53.032696 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 943/1939] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:52 2022] DELETE /identity/v3/projects/1fb9c4a987c7497a8df7e43a09e28881 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:53.037185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.038578 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:53.051463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6112ea-84b4-44a6-82e1-90674c123526 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.056247 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dea212-4f46-489c-be83-0a93b941723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.057057 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dea212-4f46-489c-be83-0a93b941723c admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.057341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dea212-4f46-489c-be83-0a93b941723c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.057618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dea212-4f46-489c-be83-0a93b941723c admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.058380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dea212-4f46-489c-be83-0a93b941723c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.060001 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dea212-4f46-489c-be83-0a93b941723c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.083198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 944/1940] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:53.083198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742c357-5233-44a7-8aa0-004a30a78c50 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.083198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742c357-5233-44a7-8aa0-004a30a78c50 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.083198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742c357-5233-44a7-8aa0-004a30a78c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.113231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f742c357-5233-44a7-8aa0-004a30a78c50 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:53.114679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f742c357-5233-44a7-8aa0-004a30a78c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:53.126991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 997/1941] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:52 2022] PUT /identity/v3/projects/4ea35541895a489ea2a4d4962d9ba2f1/users/87bebd1c8b2a4e4c95e3345a3d558021/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:53.126991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408969c-b527-4d01-8f13-d916e1ae478f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.194744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 945/1942] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:53.196359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50c64f-25cf-4670-8d88-6507dd031f02 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.196707 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50c64f-25cf-4670-8d88-6507dd031f02 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.197049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50c64f-25cf-4670-8d88-6507dd031f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.210210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408969c-b527-4d01-8f13-d916e1ae478f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.215665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006c33a-22da-4adf-b34d-8011342b47da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.216670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c33a-22da-4adf-b34d-8011342b47da admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.216994 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c33a-22da-4adf-b34d-8011342b47da admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.217336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c33a-22da-4adf-b34d-8011342b47da admin admin] PATH_INFO: `/v3/projects/bf0fbe933b98402e92ebfdbceb37fd23/users/9efbc9a169db4f4f89f7ae153ff8c8f0/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.233357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006c33a-22da-4adf-b34d-8011342b47da admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0fbe933b98402e92ebfdbceb37fd23, user_id=9efbc9a169db4f4f89f7ae153ff8c8f0, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.233552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-fc50c64f-25cf-4670-8d88-6507dd031f02 None None] MFA Rules not processed for user `87bebd1c8b2a4e4c95e3345a3d558021`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:53.234953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fc50c64f-25cf-4670-8d88-6507dd031f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:53.241751 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4006c33a-22da-4adf-b34d-8011342b47da admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.302828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 946/1943] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:53.304206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d58989-40e9-4f58-a6c4-a1bdcf7f6ef0 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.304557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d58989-40e9-4f58-a6c4-a1bdcf7f6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.304891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d58989-40e9-4f58-a6c4-a1bdcf7f6ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.321825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f2d58989-40e9-4f58-a6c4-a1bdcf7f6ef0 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:53.323050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f2d58989-40e9-4f58-a6c4-a1bdcf7f6ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:53.330233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 998/1944] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:53 2022] PUT /identity/v3/projects/bf0fbe933b98402e92ebfdbceb37fd23/users/9efbc9a169db4f4f89f7ae153ff8c8f0/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:53.330233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006c33a-22da-4adf-b34d-8011342b47da admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.331364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4006c33a-22da-4adf-b34d-8011342b47da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:53.384642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 947/1945] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:53.385561 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d58989-40e9-4f58-a6c4-a1bdcf7f6ef0 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.395170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d58989-40e9-4f58-a6c4-a1bdcf7f6ef0 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.395491 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006c33a-22da-4adf-b34d-8011342b47da admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.399794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7c451-9f29-49c5-9407-c03510f1bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.400156 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b510ae9-25cf-4719-9313-2f2eb4fb85c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.400442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c451-9f29-49c5-9407-c03510f1bd14 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.400721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c451-9f29-49c5-9407-c03510f1bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.400808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510ae9-25cf-4719-9313-2f2eb4fb85c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.400994 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c451-9f29-49c5-9407-c03510f1bd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.401081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510ae9-25cf-4719-9313-2f2eb4fb85c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.401358 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b510ae9-25cf-4719-9313-2f2eb4fb85c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.401839 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7c451-9f29-49c5-9407-c03510f1bd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.402067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b510ae9-25cf-4719-9313-2f2eb4fb85c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.403473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7c451-9f29-49c5-9407-c03510f1bd14 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.404021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b510ae9-25cf-4719-9313-2f2eb4fb85c3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.413563 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 948/1946] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:53.414370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7c451-9f29-49c5-9407-c03510f1bd14 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.423525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7c451-9f29-49c5-9407-c03510f1bd14 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.428289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd845fa-3514-4cd5-81b2-ccd2b08b8592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.428907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd845fa-3514-4cd5-81b2-ccd2b08b8592 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.429186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd845fa-3514-4cd5-81b2-ccd2b08b8592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.429455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd845fa-3514-4cd5-81b2-ccd2b08b8592 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.430206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd845fa-3514-4cd5-81b2-ccd2b08b8592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:53.430505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd845fa-3514-4cd5-81b2-ccd2b08b8592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.432054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd845fa-3514-4cd5-81b2-ccd2b08b8592 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.444053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 949/1947] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:56:53.444920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd845fa-3514-4cd5-81b2-ccd2b08b8592 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.453949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd845fa-3514-4cd5-81b2-ccd2b08b8592 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.459315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772d72c-fbc0-4e50-881a-43b5180ed9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.460138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772d72c-fbc0-4e50-881a-43b5180ed9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.460416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772d72c-fbc0-4e50-881a-43b5180ed9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.460683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772d72c-fbc0-4e50-881a-43b5180ed9f7 admin admin] PATH_INFO: `/v3/projects/bf0fbe933b98402e92ebfdbceb37fd23/users/9efbc9a169db4f4f89f7ae153ff8c8f0/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.462668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772d72c-fbc0-4e50-881a-43b5180ed9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0fbe933b98402e92ebfdbceb37fd23, user_id=9efbc9a169db4f4f89f7ae153ff8c8f0, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.465483 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772d72c-fbc0-4e50-881a-43b5180ed9f7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.475474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 950/1948] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:53 2022] PUT /identity/v3/projects/bf0fbe933b98402e92ebfdbceb37fd23/users/9efbc9a169db4f4f89f7ae153ff8c8f0/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:53.476281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772d72c-fbc0-4e50-881a-43b5180ed9f7 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.514735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 999/1949] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:53 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:53.514735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085e26e-c088-495a-a694-1908e8393f59 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.514735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085e26e-c088-495a-a694-1908e8393f59 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.514735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085e26e-c088-495a-a694-1908e8393f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.535116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772d72c-fbc0-4e50-881a-43b5180ed9f7 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.541620 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d085e26e-c088-495a-a694-1908e8393f59 None None] MFA Rules not processed for user `9efbc9a169db4f4f89f7ae153ff8c8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:53.542864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d085e26e-c088-495a-a694-1908e8393f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:53.589446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56bc4f-0bf7-460b-8f99-1092b7e5e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.590219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56bc4f-0bf7-460b-8f99-1092b7e5e067 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.590550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56bc4f-0bf7-460b-8f99-1092b7e5e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.590768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56bc4f-0bf7-460b-8f99-1092b7e5e067 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.591444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56bc4f-0bf7-460b-8f99-1092b7e5e067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.593331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56bc4f-0bf7-460b-8f99-1092b7e5e067 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.609969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1000/1950] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:53.610849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085e26e-c088-495a-a694-1908e8393f59 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.620670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085e26e-c088-495a-a694-1908e8393f59 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.625306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d253b1-61b3-4ab1-acd9-27680ea6697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.626041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d253b1-61b3-4ab1-acd9-27680ea6697e admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.626322 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d253b1-61b3-4ab1-acd9-27680ea6697e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.626594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d253b1-61b3-4ab1-acd9-27680ea6697e admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.627271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d253b1-61b3-4ab1-acd9-27680ea6697e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.629905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d253b1-61b3-4ab1-acd9-27680ea6697e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.716937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 951/1951] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:53 2022] POST /identity/v3/projects => generated 385 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:53.717817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56bc4f-0bf7-460b-8f99-1092b7e5e067 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.719398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ec56bc4f-0bf7-460b-8f99-1092b7e5e067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:53.732571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1001/1952] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:53 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:53.733556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d253b1-61b3-4ab1-acd9-27680ea6697e admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.744257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d253b1-61b3-4ab1-acd9-27680ea6697e admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.776623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56bc4f-0bf7-460b-8f99-1092b7e5e067 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.780364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e366-3540-40ba-a5ec-41c7e2fc2ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.781038 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e366-3540-40ba-a5ec-41c7e2fc2ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.781329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e366-3540-40ba-a5ec-41c7e2fc2ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.781607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4e366-3540-40ba-a5ec-41c7e2fc2ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.798652 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bd49a-8c44-49ba-b990-71a46c227d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.799353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bd49a-8c44-49ba-b990-71a46c227d90 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.799636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bd49a-8c44-49ba-b990-71a46c227d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.799948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bd49a-8c44-49ba-b990-71a46c227d90 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.801388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bd49a-8c44-49ba-b990-71a46c227d90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.803331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bd49a-8c44-49ba-b990-71a46c227d90 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.848011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e366-3540-40ba-a5ec-41c7e2fc2ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.849403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4e366-3540-40ba-a5ec-41c7e2fc2ee3 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.859006 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 952/1953] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:53.859862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e366-3540-40ba-a5ec-41c7e2fc2ee3 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.870251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4e366-3540-40ba-a5ec-41c7e2fc2ee3 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.875218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0b822-3334-41e1-a743-251cf925f4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.875874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b822-3334-41e1-a743-251cf925f4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.876156 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b822-3334-41e1-a743-251cf925f4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.876449 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b822-3334-41e1-a743-251cf925f4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.877206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0b822-3334-41e1-a743-251cf925f4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.879548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0b822-3334-41e1-a743-251cf925f4f6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.889509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 953/1954] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:53.896387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0b822-3334-41e1-a743-251cf925f4f6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.905869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0b822-3334-41e1-a743-251cf925f4f6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.910881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7d49d-a5c7-4bac-baad-b3f5c5164b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.911503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d49d-a5c7-4bac-baad-b3f5c5164b20 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.911801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d49d-a5c7-4bac-baad-b3f5c5164b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.912069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d49d-a5c7-4bac-baad-b3f5c5164b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.912768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d49d-a5c7-4bac-baad-b3f5c5164b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.914418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d49d-a5c7-4bac-baad-b3f5c5164b20 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.921575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1002/1955] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:53 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:53.925916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 954/1956] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:53.930492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bd49a-8c44-49ba-b990-71a46c227d90 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.930856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7d49d-a5c7-4bac-baad-b3f5c5164b20 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.940418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7d49d-a5c7-4bac-baad-b3f5c5164b20 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.941959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bd49a-8c44-49ba-b990-71a46c227d90 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.946421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa097d-851f-4ae0-b635-bc78d87b8b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.947117 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c7184-985d-42f5-b575-adbee929d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.947326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa097d-851f-4ae0-b635-bc78d87b8b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.947574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa097d-851f-4ae0-b635-bc78d87b8b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.947781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c7184-985d-42f5-b575-adbee929d6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.947890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa097d-851f-4ae0-b635-bc78d87b8b97 admin admin] PATH_INFO: `/v3/projects/6cee9d19db9d4e64a27e46896abd4270/users/0111d4fa43734aae8d2b15e9e7eb0af2/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.948122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c7184-985d-42f5-b575-adbee929d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.948368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c7184-985d-42f5-b575-adbee929d6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.949241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c7184-985d-42f5-b575-adbee929d6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.950864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c7184-985d-42f5-b575-adbee929d6b6 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.965592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa097d-851f-4ae0-b635-bc78d87b8b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cee9d19db9d4e64a27e46896abd4270, user_id=0111d4fa43734aae8d2b15e9e7eb0af2, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.966356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1003/1957] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:53.969964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c7184-985d-42f5-b575-adbee929d6b6 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:53.971410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa097d-851f-4ae0-b635-bc78d87b8b97 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:53.980704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c7184-985d-42f5-b575-adbee929d6b6 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:53.985535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d40a9-31a6-4ac0-866a-9fa5854dabcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:53.986221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d40a9-31a6-4ac0-866a-9fa5854dabcc admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:53.986504 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d40a9-31a6-4ac0-866a-9fa5854dabcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:53.986777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d40a9-31a6-4ac0-866a-9fa5854dabcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:53.987548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d40a9-31a6-4ac0-866a-9fa5854dabcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:53.990164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d40a9-31a6-4ac0-866a-9fa5854dabcc admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:54.005822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1004/1958] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:54.006725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d40a9-31a6-4ac0-866a-9fa5854dabcc admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:54.016067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d40a9-31a6-4ac0-866a-9fa5854dabcc admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:54.020818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68942709-e5e9-426e-8c9e-26bb43aff12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:54.021679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942709-e5e9-426e-8c9e-26bb43aff12f admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.021956 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942709-e5e9-426e-8c9e-26bb43aff12f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.022263 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942709-e5e9-426e-8c9e-26bb43aff12f admin admin] PATH_INFO: `/v3/projects/1764732e0bf34c8c9325584d95f4e883/users/522d5390de8a46469f5886ffc8eedb37/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.037158 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68942709-e5e9-426e-8c9e-26bb43aff12f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1764732e0bf34c8c9325584d95f4e883, user_id=522d5390de8a46469f5886ffc8eedb37, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:54.039938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68942709-e5e9-426e-8c9e-26bb43aff12f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:54.070868 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 955/1959] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:53 2022] PUT /identity/v3/projects/6cee9d19db9d4e64a27e46896abd4270/users/0111d4fa43734aae8d2b15e9e7eb0af2/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:54.082465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726cf6e-70f6-40a3-9f48-cd765fec1b63 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.082749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726cf6e-70f6-40a3-9f48-cd765fec1b63 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.083019 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726cf6e-70f6-40a3-9f48-cd765fec1b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.110628 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8726cf6e-70f6-40a3-9f48-cd765fec1b63 None None] MFA Rules not processed for user `0111d4fa43734aae8d2b15e9e7eb0af2`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:54.111878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8726cf6e-70f6-40a3-9f48-cd765fec1b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:54.171922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1005/1960] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:54 2022] PUT /identity/v3/projects/1764732e0bf34c8c9325584d95f4e883/users/522d5390de8a46469f5886ffc8eedb37/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:54.192307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904e43-c51a-4913-9fce-2b1d80bb1432 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.192734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904e43-c51a-4913-9fce-2b1d80bb1432 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.193120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a904e43-c51a-4913-9fce-2b1d80bb1432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.204608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 956/1961] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:54.210789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726cf6e-70f6-40a3-9f48-cd765fec1b63 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:54.227294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4a904e43-c51a-4913-9fce-2b1d80bb1432 None None] MFA Rules not processed for user `522d5390de8a46469f5886ffc8eedb37`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:54.228956 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4a904e43-c51a-4913-9fce-2b1d80bb1432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:54.285716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726cf6e-70f6-40a3-9f48-cd765fec1b63 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:54.329296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1006/1962] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:54.330810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a904e43-c51a-4913-9fce-2b1d80bb1432 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:54.384784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f67e7-0fe4-473f-baa8-36c961093ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:54.385615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f67e7-0fe4-473f-baa8-36c961093ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.386147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f67e7-0fe4-473f-baa8-36c961093ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.386575 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f67e7-0fe4-473f-baa8-36c961093ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.387624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f67e7-0fe4-473f-baa8-36c961093ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:54.392775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f67e7-0fe4-473f-baa8-36c961093ac6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:54.419898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a904e43-c51a-4913-9fce-2b1d80bb1432 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:54.424359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004dd60-dd5d-47ea-a1cd-0abcff3f144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:54.425015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004dd60-dd5d-47ea-a1cd-0abcff3f144a admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.425926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004dd60-dd5d-47ea-a1cd-0abcff3f144a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.426225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004dd60-dd5d-47ea-a1cd-0abcff3f144a admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.427036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004dd60-dd5d-47ea-a1cd-0abcff3f144a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:54.428928 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004dd60-dd5d-47ea-a1cd-0abcff3f144a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:54.527396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 957/1963] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:54 2022] POST /identity/v3/projects => generated 377 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:54.528267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f67e7-0fe4-473f-baa8-36c961093ac6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:54.568377 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1007/1964] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:54 2022] POST /identity/v3/projects => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:54.572193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004dd60-dd5d-47ea-a1cd-0abcff3f144a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:54.588841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f67e7-0fe4-473f-baa8-36c961093ac6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:54.633014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004dd60-dd5d-47ea-a1cd-0abcff3f144a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:54.643038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5f59b-6259-4c67-8e59-731ffe6a8ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:54.651488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5f59b-6259-4c67-8e59-731ffe6a8ada admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.651830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c061b-4113-42f2-bd19-1086a9381519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:54.651937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5f59b-6259-4c67-8e59-731ffe6a8ada admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.651937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5f59b-6259-4c67-8e59-731ffe6a8ada admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.652082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c061b-4113-42f2-bd19-1086a9381519 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.652156 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5f59b-6259-4c67-8e59-731ffe6a8ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:54.652223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c061b-4113-42f2-bd19-1086a9381519 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.652223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c061b-4113-42f2-bd19-1086a9381519 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.652223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c061b-4113-42f2-bd19-1086a9381519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:54.652413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5f59b-6259-4c67-8e59-731ffe6a8ada admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:54.652479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c061b-4113-42f2-bd19-1086a9381519 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:54.750575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1008/1965] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:54 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:56:54.751071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 958/1966] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:54 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:54.755158 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5f59b-6259-4c67-8e59-731ffe6a8ada admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:54.757115 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c061b-4113-42f2-bd19-1086a9381519 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:54.765360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5f59b-6259-4c67-8e59-731ffe6a8ada admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:54.767737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c061b-4113-42f2-bd19-1086a9381519 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:54.771162 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68215f22-d462-44f9-9034-b19d65bbb3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:54.771955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68215f22-d462-44f9-9034-b19d65bbb3ab admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.772247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68215f22-d462-44f9-9034-b19d65bbb3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.772519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68215f22-d462-44f9-9034-b19d65bbb3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.776000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c59ff7-e4a3-469e-86e9-647a700391ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:54.776321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68215f22-d462-44f9-9034-b19d65bbb3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:54.776418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59ff7-e4a3-469e-86e9-647a700391ad admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.776418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59ff7-e4a3-469e-86e9-647a700391ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.776418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c59ff7-e4a3-469e-86e9-647a700391ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.776637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68215f22-d462-44f9-9034-b19d65bbb3ab admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:54.776704 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c59ff7-e4a3-469e-86e9-647a700391ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:54.777117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c59ff7-e4a3-469e-86e9-647a700391ad admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:54.788128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1009/1967] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:54.792281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 959/1968] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:54.792281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c59ff7-e4a3-469e-86e9-647a700391ad admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:54.793362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68215f22-d462-44f9-9034-b19d65bbb3ab admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:54.803265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c59ff7-e4a3-469e-86e9-647a700391ad admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:54.804091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68215f22-d462-44f9-9034-b19d65bbb3ab admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:54.808354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16a520-0384-4e9b-bedc-b17c92d0cb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:54.808886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78bcc8-6f98-4589-b21d-33fda3498056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:54.809373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a520-0384-4e9b-bedc-b17c92d0cb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.809795 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a520-0384-4e9b-bedc-b17c92d0cb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.809899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78bcc8-6f98-4589-b21d-33fda3498056 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:54.810152 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a520-0384-4e9b-bedc-b17c92d0cb14 admin admin] PATH_INFO: `/v3/projects/49c00704d70848918498cadd3a55dce2/users/4ef011d5fe374f6598516b4f3e25bfc9/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.810256 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78bcc8-6f98-4589-b21d-33fda3498056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:54.810424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78bcc8-6f98-4589-b21d-33fda3498056 admin admin] PATH_INFO: `/v3/projects/6db0a48f4f24439eb5337835ac2deac7/users/b3a6b19c2b7441c2bea9dcc3dd1ff8d1/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:54.825973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78bcc8-6f98-4589-b21d-33fda3498056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db0a48f4f24439eb5337835ac2deac7, user_id=b3a6b19c2b7441c2bea9dcc3dd1ff8d1, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:54.828675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78bcc8-6f98-4589-b21d-33fda3498056 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:54.832280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16a520-0384-4e9b-bedc-b17c92d0cb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c00704d70848918498cadd3a55dce2, user_id=4ef011d5fe374f6598516b4f3e25bfc9, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:54.833648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16a520-0384-4e9b-bedc-b17c92d0cb14 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:54.946948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 960/1969] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:54 2022] PUT /identity/v3/projects/49c00704d70848918498cadd3a55dce2/users/4ef011d5fe374f6598516b4f3e25bfc9/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:54.948138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1010/1970] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:54 2022] PUT /identity/v3/projects/6db0a48f4f24439eb5337835ac2deac7/users/b3a6b19c2b7441c2bea9dcc3dd1ff8d1/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:54.956574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16a520-0384-4e9b-bedc-b17c92d0cb14 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:54.958894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78bcc8-6f98-4589-b21d-33fda3498056 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:55.028434 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78bcc8-6f98-4589-b21d-33fda3498056 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:55.033132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6d135-8518-45a1-bb1a-474442847c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:55.033794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6d135-8518-45a1-bb1a-474442847c47 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:55.034296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6d135-8518-45a1-bb1a-474442847c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:55.034597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6d135-8518-45a1-bb1a-474442847c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:55.035315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6d135-8518-45a1-bb1a-474442847c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:55.038944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6d135-8518-45a1-bb1a-474442847c47 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:55.039080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16a520-0384-4e9b-bedc-b17c92d0cb14 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:55.047511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1ad5a-8908-45ed-af47-a5ff5490ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:55.047511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1ad5a-8908-45ed-af47-a5ff5490ad7e admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:55.047511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1ad5a-8908-45ed-af47-a5ff5490ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:55.047511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1ad5a-8908-45ed-af47-a5ff5490ad7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:55.047848 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1ad5a-8908-45ed-af47-a5ff5490ad7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:55.052487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1011/1971] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:56:55.052650 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b1ad5a-8908-45ed-af47-a5ff5490ad7e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:55.053258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6d135-8518-45a1-bb1a-474442847c47 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:55.060185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 961/1972] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:55.062992 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6d135-8518-45a1-bb1a-474442847c47 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:55.064377 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1ad5a-8908-45ed-af47-a5ff5490ad7e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:55.068908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae849b-737f-47dd-9453-c36f2ba29fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:55.069789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae849b-737f-47dd-9453-c36f2ba29fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:55.070103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae849b-737f-47dd-9453-c36f2ba29fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:55.070380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae849b-737f-47dd-9453-c36f2ba29fe3 admin admin] PATH_INFO: `/v3/projects/6db0a48f4f24439eb5337835ac2deac7/users/b3a6b19c2b7441c2bea9dcc3dd1ff8d1/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:55.072383 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae849b-737f-47dd-9453-c36f2ba29fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db0a48f4f24439eb5337835ac2deac7, user_id=b3a6b19c2b7441c2bea9dcc3dd1ff8d1, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:55.074346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1ad5a-8908-45ed-af47-a5ff5490ad7e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:55.075137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae849b-737f-47dd-9453-c36f2ba29fe3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:55.078966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696610fe-eda6-453a-ac87-5c895674232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:55.079818 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696610fe-eda6-453a-ac87-5c895674232a admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:55.080094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696610fe-eda6-453a-ac87-5c895674232a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:55.080366 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696610fe-eda6-453a-ac87-5c895674232a admin admin] PATH_INFO: `/v3/projects/49c00704d70848918498cadd3a55dce2/users/4ef011d5fe374f6598516b4f3e25bfc9/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:55.083003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696610fe-eda6-453a-ac87-5c895674232a admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c00704d70848918498cadd3a55dce2, user_id=4ef011d5fe374f6598516b4f3e25bfc9, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:55.085671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696610fe-eda6-453a-ac87-5c895674232a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:55.086463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1012/1973] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:55 2022] PUT /identity/v3/projects/6db0a48f4f24439eb5337835ac2deac7/users/b3a6b19c2b7441c2bea9dcc3dd1ff8d1/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:55.096585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460bce4-efed-4f41-a769-55c1e4cfdd6a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:55.096735 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 962/1974] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:56:55 2022] PUT /identity/v3/projects/49c00704d70848918498cadd3a55dce2/users/4ef011d5fe374f6598516b4f3e25bfc9/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:55.097898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460bce4-efed-4f41-a769-55c1e4cfdd6a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:55.097898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460bce4-efed-4f41-a769-55c1e4cfdd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:55.106954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d441c-d60c-4c75-8125-40306e5d12b7 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:55.107241 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d441c-d60c-4c75-8125-40306e5d12b7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:55.107659 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d441c-d60c-4c75-8125-40306e5d12b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:55.123840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-7460bce4-efed-4f41-a769-55c1e4cfdd6a None None] MFA Rules not processed for user `b3a6b19c2b7441c2bea9dcc3dd1ff8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:55.125047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7460bce4-efed-4f41-a769-55c1e4cfdd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:55.140559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-819d441c-d60c-4c75-8125-40306e5d12b7 None None] MFA Rules not processed for user `4ef011d5fe374f6598516b4f3e25bfc9`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:55.143885 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-819d441c-d60c-4c75-8125-40306e5d12b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:55.195899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1013/1975] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:55.197014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460bce4-efed-4f41-a769-55c1e4cfdd6a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:55.211138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 963/1976] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:55.212314 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d441c-d60c-4c75-8125-40306e5d12b7 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:55.260075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460bce4-efed-4f41-a769-55c1e4cfdd6a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:55.264831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:55.265695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:55.265976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:55.266276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] PATH_INFO: `/v3/users/dfbba85a69e84eafb3b17ec8721f56b2` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:55.267466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfbba85a69e84eafb3b17ec8721f56b2)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:55.267573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d441c-d60c-4c75-8125-40306e5d12b7 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:55.270196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:55.271838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681afab-e005-445d-aeeb-926215a8005a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:55.272479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681afab-e005-445d-aeeb-926215a8005a service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:55.272755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681afab-e005-445d-aeeb-926215a8005a service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:55.273027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681afab-e005-445d-aeeb-926215a8005a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:55.282561 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681afab-e005-445d-aeeb-926215a8005a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:55.283974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681afab-e005-445d-aeeb-926215a8005a service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:55.294033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 964/1977] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:55.294900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681afab-e005-445d-aeeb-926215a8005a service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:55.296277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c681afab-e005-445d-aeeb-926215a8005a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:55.307017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681afab-e005-445d-aeeb-926215a8005a service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:55.310726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727efe69-73d4-452b-95e7-e529571cf848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:55.311342 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727efe69-73d4-452b-95e7-e529571cf848 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:55.311620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727efe69-73d4-452b-95e7-e529571cf848 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:55.311922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727efe69-73d4-452b-95e7-e529571cf848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:55.325158 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727efe69-73d4-452b-95e7-e529571cf848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:55.326623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727efe69-73d4-452b-95e7-e529571cf848 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:55.336923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 965/1978] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:55.337729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727efe69-73d4-452b-95e7-e529571cf848 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:55.348581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727efe69-73d4-452b-95e7-e529571cf848 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:55.353321 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:55.382682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:55.382682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:55.382682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] PATH_INFO: `/v3/users/522d5390de8a46469f5886ffc8eedb37` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:55.382682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522d5390de8a46469f5886ffc8eedb37)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:55.382682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:55.683870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfbba85a69e84eafb3b17ec8721f56b2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:55.692518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfbba85a69e84eafb3b17ec8721f56b2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:56.569738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522d5390de8a46469f5886ffc8eedb37'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:56.570420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522d5390de8a46469f5886ffc8eedb37'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:56.595592 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfbba85a69e84eafb3b17ec8721f56b2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:56.608091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfbba85a69e84eafb3b17ec8721f56b2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:56.608884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfbba85a69e84eafb3b17ec8721f56b2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:56.616955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1014/1979] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:55 2022] DELETE /identity/v3/users/dfbba85a69e84eafb3b17ec8721f56b2 => generated 0 bytes in 1419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:56.616955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:56.617909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:56.664292 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522d5390de8a46469f5886ffc8eedb37'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:56.676146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522d5390de8a46469f5886ffc8eedb37'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:56.689340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5c9ca2a2-14b0-45d3-8b06-16c8d8ea1f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522d5390de8a46469f5886ffc8eedb37'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:56.694939 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafcbd5-b2eb-461e-8dff-a1d33666593a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:56.699864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 966/1980] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:55 2022] DELETE /identity/v3/users/522d5390de8a46469f5886ffc8eedb37 => generated 0 bytes in 1360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:56.699864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc1a8-9758-4087-b9b3-0ad880f101ab None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:56.699864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc1a8-9758-4087-b9b3-0ad880f101ab None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:56.699864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dc1a8-9758-4087-b9b3-0ad880f101ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:56.718039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-c84dc1a8-9758-4087-b9b3-0ad880f101ab None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:56.719419 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c84dc1a8-9758-4087-b9b3-0ad880f101ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:56.750864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9deb33-455d-4e23-93b2-5f86e90be442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:56.751573 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9deb33-455d-4e23-93b2-5f86e90be442 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:56.751855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9deb33-455d-4e23-93b2-5f86e90be442 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:56.752124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9deb33-455d-4e23-93b2-5f86e90be442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:56.754649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-bf9deb33-455d-4e23-93b2-5f86e90be442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:56.791249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 967/1981] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:56.803267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da4777-c6f4-4954-ab70-2705b84b3a57 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:56.806750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da4777-c6f4-4954-ab70-2705b84b3a57 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:56.806750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da4777-c6f4-4954-ab70-2705b84b3a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:56.826033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9deb33-455d-4e23-93b2-5f86e90be442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:56.827850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9deb33-455d-4e23-93b2-5f86e90be442 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:56.829410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-78da4777-c6f4-4954-ab70-2705b84b3a57 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:56.832487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-78da4777-c6f4-4954-ab70-2705b84b3a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:56.839403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1015/1982] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:56.840408 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9deb33-455d-4e23-93b2-5f86e90be442 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:56.841795 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-bf9deb33-455d-4e23-93b2-5f86e90be442 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:56.843982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 968/1983] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:56.857424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da4777-c6f4-4954-ab70-2705b84b3a57 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:56.862896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-78da4777-c6f4-4954-ab70-2705b84b3a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:56.913507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9deb33-455d-4e23-93b2-5f86e90be442 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:56.918151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ee77b-bec9-48df-bea8-8e3ebe30962d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:56.918824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ee77b-bec9-48df-bea8-8e3ebe30962d service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:56.919180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ee77b-bec9-48df-bea8-8e3ebe30962d service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:56.919374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ee77b-bec9-48df-bea8-8e3ebe30962d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:56.944649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ee77b-bec9-48df-bea8-8e3ebe30962d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:56.944649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ee77b-bec9-48df-bea8-8e3ebe30962d service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:56.944985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da4777-c6f4-4954-ab70-2705b84b3a57 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:56.944985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2675cb-8a31-42ae-9e26-621090590550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:56.944985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2675cb-8a31-42ae-9e26-621090590550 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:56.944985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2675cb-8a31-42ae-9e26-621090590550 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:56.945421 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1016/1984] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:56.945524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2675cb-8a31-42ae-9e26-621090590550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:56.954807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2675cb-8a31-42ae-9e26-621090590550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:56.956235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2675cb-8a31-42ae-9e26-621090590550 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:56.967456 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 969/1985] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:56:57.636074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ee77b-bec9-48df-bea8-8e3ebe30962d service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:57.636074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3f9ee77b-bec9-48df-bea8-8e3ebe30962d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:57.638783 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2675cb-8a31-42ae-9e26-621090590550 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:57.640175 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1c2675cb-8a31-42ae-9e26-621090590550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:57.655171 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ee77b-bec9-48df-bea8-8e3ebe30962d service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:57.663420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:57.663712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2675cb-8a31-42ae-9e26-621090590550 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:57.664570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:57.665100 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:57.665351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] PATH_INFO: `/v3/projects/1764732e0bf34c8c9325584d95f4e883` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:57.667654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1764732e0bf34c8c9325584d95f4e883)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:57.681638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:57.681638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:57.682369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:57.682798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:57.682798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] PATH_INFO: `/v3/projects/9a09a9a436dc486c8b8bdc80d2d655ae` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:57.682798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a09a9a436dc486c8b8bdc80d2d655ae)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:57.682798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:57.825360 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a09a9a436dc486c8b8bdc80d2d655ae', 'request_id': 'req-e4cf21eb-f1ec-4069-a929-f921a2f3dade'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:57.837424 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a09a9a436dc486c8b8bdc80d2d655ae', 'request_id': 'req-e4cf21eb-f1ec-4069-a929-f921a2f3dade'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:57.844026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a09a9a436dc486c8b8bdc80d2d655ae', 'request_id': 'req-e4cf21eb-f1ec-4069-a929-f921a2f3dade'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:57.857817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1764732e0bf34c8c9325584d95f4e883', 'request_id': 'req-9f54f15d-fb71-4d40-b903-74083ce31682'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:57.864314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1764732e0bf34c8c9325584d95f4e883', 'request_id': 'req-9f54f15d-fb71-4d40-b903-74083ce31682'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:57.939495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] The token cache is being invalidate because project 9a09a9a436dc486c8b8bdc80d2d655ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:57.939883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:57.940587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:57.944312 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 970/1986] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:57 2022] DELETE /identity/v3/projects/9a09a9a436dc486c8b8bdc80d2d655ae => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:57.948821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:57.950229 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:58.032873 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf21eb-f1ec-4069-a929-f921a2f3dade admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:58.036563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1764732e0bf34c8c9325584d95f4e883', 'request_id': 'req-9f54f15d-fb71-4d40-b903-74083ce31682'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.048356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] The token cache is being invalidate because project 1764732e0bf34c8c9325584d95f4e883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:58.048867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.049543 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.051710 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1017/1987] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:57 2022] DELETE /identity/v3/projects/1764732e0bf34c8c9325584d95f4e883 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:58.055406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:58.056837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:58.098932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:58.099827 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:58.100197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:58.100446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] PATH_INFO: `/v3/users/9efbc9a169db4f4f89f7ae153ff8c8f0` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:58.102604 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efbc9a169db4f4f89f7ae153ff8c8f0)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:58.104567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:58.128791 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54f15d-fb71-4d40-b903-74083ce31682 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:58.134524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:58.135462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:58.135753 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:58.136164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] PATH_INFO: `/v3/users/b3a6b19c2b7441c2bea9dcc3dd1ff8d1` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:58.137437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a6b19c2b7441c2bea9dcc3dd1ff8d1)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:58.139768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:58.341708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a6b19c2b7441c2bea9dcc3dd1ff8d1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.341919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efbc9a169db4f4f89f7ae153ff8c8f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.342769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efbc9a169db4f4f89f7ae153ff8c8f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.349968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a6b19c2b7441c2bea9dcc3dd1ff8d1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.395856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efbc9a169db4f4f89f7ae153ff8c8f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.408380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efbc9a169db4f4f89f7ae153ff8c8f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.422139 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efbc9a169db4f4f89f7ae153ff8c8f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.429046 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 971/1988] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:57 2022] DELETE /identity/v3/users/9efbc9a169db4f4f89f7ae153ff8c8f0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:58.488295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a6b19c2b7441c2bea9dcc3dd1ff8d1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.507209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a6b19c2b7441c2bea9dcc3dd1ff8d1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.508050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-38eceda1-0134-47d2-b0b3-fb567847e404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a6b19c2b7441c2bea9dcc3dd1ff8d1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:58.514946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1018/1989] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:56:58 2022] DELETE /identity/v3/users/b3a6b19c2b7441c2bea9dcc3dd1ff8d1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:56:58.936280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:58.938525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:59.037538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420ee9b-260d-404e-b03d-06e751758f80 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:59.095519 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:59.096555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.096813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.097711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] PATH_INFO: `/v3/projects/bf0fbe933b98402e92ebfdbceb37fd23` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.099331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0fbe933b98402e92ebfdbceb37fd23)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:59.101252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:59.201461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0fbe933b98402e92ebfdbceb37fd23', 'request_id': 'req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:59.209500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0fbe933b98402e92ebfdbceb37fd23', 'request_id': 'req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:59.215756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0fbe933b98402e92ebfdbceb37fd23', 'request_id': 'req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:59.304866 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] The token cache is being invalidate because project bf0fbe933b98402e92ebfdbceb37fd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:59.305155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:59.305794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a8bfd770-02a5-41d5-bd49-515dcdda1e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:59.307414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 972/1990] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:58 2022] DELETE /identity/v3/projects/bf0fbe933b98402e92ebfdbceb37fd23 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:59.312569 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397123e0-648e-4ef5-916c-65bd02ef9fbb None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.313061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397123e0-648e-4ef5-916c-65bd02ef9fbb None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.313160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397123e0-648e-4ef5-916c-65bd02ef9fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.331252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-397123e0-648e-4ef5-916c-65bd02ef9fbb None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:59.333489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-397123e0-648e-4ef5-916c-65bd02ef9fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:59.399739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1019/1991] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:59.407512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87522d-edaf-4e45-9559-62270fa93ada None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.410026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87522d-edaf-4e45-9559-62270fa93ada None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.410026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87522d-edaf-4e45-9559-62270fa93ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.426647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8a87522d-edaf-4e45-9559-62270fa93ada None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:59.427973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8a87522d-edaf-4e45-9559-62270fa93ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:59.435933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 973/1992] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:59.440057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397123e0-648e-4ef5-916c-65bd02ef9fbb None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:59.450155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397123e0-648e-4ef5-916c-65bd02ef9fbb None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:59.455911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bda536-9d73-4055-9739-dce4c2143ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:59.457831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda536-9d73-4055-9739-dce4c2143ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.457831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda536-9d73-4055-9739-dce4c2143ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.458041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bda536-9d73-4055-9739-dce4c2143ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.458690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bda536-9d73-4055-9739-dce4c2143ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:59.458991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bda536-9d73-4055-9739-dce4c2143ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:59.460610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bda536-9d73-4055-9739-dce4c2143ad1 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:59.467388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87522d-edaf-4e45-9559-62270fa93ada None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:59.469192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8a87522d-edaf-4e45-9559-62270fa93ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:59.479110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1020/1993] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:56:59.485137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bda536-9d73-4055-9739-dce4c2143ad1 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:59.486334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87522d-edaf-4e45-9559-62270fa93ada None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:59.492015 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:59.493026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.493153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bda536-9d73-4055-9739-dce4c2143ad1 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:59.493428 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.493776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] PATH_INFO: `/v3/projects/6db0a48f4f24439eb5337835ac2deac7` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.495306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db0a48f4f24439eb5337835ac2deac7)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:59.497464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:59.498018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9c250-3dde-4e1e-bed8-76c307ccd921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:59.498663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c250-3dde-4e1e-bed8-76c307ccd921 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.498943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c250-3dde-4e1e-bed8-76c307ccd921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.499217 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c250-3dde-4e1e-bed8-76c307ccd921 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.501465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9c250-3dde-4e1e-bed8-76c307ccd921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:59.502595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9c250-3dde-4e1e-bed8-76c307ccd921 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:59.647780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1021/1994] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:59 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:59.649274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9c250-3dde-4e1e-bed8-76c307ccd921 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:59.666636 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db0a48f4f24439eb5337835ac2deac7', 'request_id': 'req-5231acf9-f4d4-418d-a695-7fecf7495c17'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:59.673786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db0a48f4f24439eb5337835ac2deac7', 'request_id': 'req-5231acf9-f4d4-418d-a695-7fecf7495c17'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:59.680556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db0a48f4f24439eb5337835ac2deac7', 'request_id': 'req-5231acf9-f4d4-418d-a695-7fecf7495c17'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:59.740085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] The token cache is being invalidate because project 6db0a48f4f24439eb5337835ac2deac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:56:59.741217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:59.743413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-5231acf9-f4d4-418d-a695-7fecf7495c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:56:59.745934 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 974/1995] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:56:59 2022] DELETE /identity/v3/projects/6db0a48f4f24439eb5337835ac2deac7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:56:59.746154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9c250-3dde-4e1e-bed8-76c307ccd921 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:59.751894 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a57a5-cbd4-43e7-ac10-dbae18e3bf98 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.752353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a57a5-cbd4-43e7-ac10-dbae18e3bf98 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.752918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a57a5-cbd4-43e7-ac10-dbae18e3bf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.776963 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6c8a57a5-cbd4-43e7-ac10-dbae18e3bf98 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:59.778621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6c8a57a5-cbd4-43e7-ac10-dbae18e3bf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:59.827216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d4303-de85-41a2-98bf-291b4b9955ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:59.828423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d4303-de85-41a2-98bf-291b4b9955ae admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.828993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d4303-de85-41a2-98bf-291b4b9955ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.829278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d4303-de85-41a2-98bf-291b4b9955ae admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.830153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d4303-de85-41a2-98bf-291b4b9955ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:59.832711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d4303-de85-41a2-98bf-291b4b9955ae admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:59.849391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 975/1996] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:56:59.857619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e727d-0347-4317-b3ed-36c8c9d4cd3a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.858024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e727d-0347-4317-b3ed-36c8c9d4cd3a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.859558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e727d-0347-4317-b3ed-36c8c9d4cd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.878403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-5f6e727d-0347-4317-b3ed-36c8c9d4cd3a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:56:59.879641 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5f6e727d-0347-4317-b3ed-36c8c9d4cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:59.887701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 976/1997] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:56:59.891858 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e727d-0347-4317-b3ed-36c8c9d4cd3a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:59.901550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e727d-0347-4317-b3ed-36c8c9d4cd3a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:59.907445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8035dd-50d8-44b4-a3f5-ed1eaa336a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:59.908120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8035dd-50d8-44b4-a3f5-ed1eaa336a1e admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.913396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1022/1998] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:56:59 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:56:59.913549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8035dd-50d8-44b4-a3f5-ed1eaa336a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.913549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8035dd-50d8-44b4-a3f5-ed1eaa336a1e admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.919417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8035dd-50d8-44b4-a3f5-ed1eaa336a1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:56:59.919417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8035dd-50d8-44b4-a3f5-ed1eaa336a1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:59.919417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8035dd-50d8-44b4-a3f5-ed1eaa336a1e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:59.920781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d4303-de85-41a2-98bf-291b4b9955ae admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:59.924120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-359d4303-de85-41a2-98bf-291b4b9955ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:56:59.936088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d4303-de85-41a2-98bf-291b4b9955ae admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:59.938647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 977/1999] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:56:59.943135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8035dd-50d8-44b4-a3f5-ed1eaa336a1e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:59.944973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fed499-6d7e-4457-b252-dd48554b4718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:59.945644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fed499-6d7e-4457-b252-dd48554b4718 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.945930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fed499-6d7e-4457-b252-dd48554b4718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.946248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fed499-6d7e-4457-b252-dd48554b4718 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.946984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fed499-6d7e-4457-b252-dd48554b4718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:59.948586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fed499-6d7e-4457-b252-dd48554b4718 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:59.953916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8035dd-50d8-44b4-a3f5-ed1eaa336a1e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:56:59.960410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6af56d-711c-42ff-b34b-859874e1774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:56:59.964008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af56d-711c-42ff-b34b-859874e1774b admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:56:59.964146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1023/2000] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:56:59.964271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af56d-711c-42ff-b34b-859874e1774b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:56:59.964271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af56d-711c-42ff-b34b-859874e1774b admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:56:59.964271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6af56d-711c-42ff-b34b-859874e1774b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:56:59.965097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6af56d-711c-42ff-b34b-859874e1774b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:56:59.965221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fed499-6d7e-4457-b252-dd48554b4718 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:56:59.984788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fed499-6d7e-4457-b252-dd48554b4718 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:00.004002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181768-1d57-41e1-aae9-78ac2a6c5fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:00.004002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181768-1d57-41e1-aae9-78ac2a6c5fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.004002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181768-1d57-41e1-aae9-78ac2a6c5fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.004002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181768-1d57-41e1-aae9-78ac2a6c5fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.005722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04181768-1d57-41e1-aae9-78ac2a6c5fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:00.005722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04181768-1d57-41e1-aae9-78ac2a6c5fb8 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:00.009626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1024/2001] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:00.013794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181768-1d57-41e1-aae9-78ac2a6c5fb8 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:00.037758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181768-1d57-41e1-aae9-78ac2a6c5fb8 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:00.042720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c46db-47fd-412c-8687-098457b49f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:00.043614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c46db-47fd-412c-8687-098457b49f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.043892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c46db-47fd-412c-8687-098457b49f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.044165 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c46db-47fd-412c-8687-098457b49f9f admin admin] PATH_INFO: `/v3/projects/c4cef706a1b94c96b53b990aafada997/users/30d7907f5710467b97d8db0789fbfab2/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.061658 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c46db-47fd-412c-8687-098457b49f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4cef706a1b94c96b53b990aafada997, user_id=30d7907f5710467b97d8db0789fbfab2, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:00.064954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c46db-47fd-412c-8687-098457b49f9f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:00.067027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 978/2002] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:56:59 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:00.071883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6af56d-711c-42ff-b34b-859874e1774b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:00.151337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1025/2003] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:00 2022] PUT /identity/v3/projects/c4cef706a1b94c96b53b990aafada997/users/30d7907f5710467b97d8db0789fbfab2/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:00.152874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ce93-2586-49d9-a686-5b4df63ad2b4 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.153169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ce93-2586-49d9-a686-5b4df63ad2b4 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.153449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ce93-2586-49d9-a686-5b4df63ad2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.154906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6af56d-711c-42ff-b34b-859874e1774b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:00.184766 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-9764ce93-2586-49d9-a686-5b4df63ad2b4 None None] MFA Rules not processed for user `30d7907f5710467b97d8db0789fbfab2`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:00.186018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9764ce93-2586-49d9-a686-5b4df63ad2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:00.245834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbb523-c75d-42ee-bd4a-168081267e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:00.246582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb523-c75d-42ee-bd4a-168081267e1e admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.246863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb523-c75d-42ee-bd4a-168081267e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.247174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb523-c75d-42ee-bd4a-168081267e1e admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.248144 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbb523-c75d-42ee-bd4a-168081267e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:00.249865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbb523-c75d-42ee-bd4a-168081267e1e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:00.267032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1026/2004] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:00.272220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764ce93-2586-49d9-a686-5b4df63ad2b4 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:00.282719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764ce93-2586-49d9-a686-5b4df63ad2b4 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:00.287362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82aa268-65cf-4e81-8d47-366f3b7ec653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:00.288007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82aa268-65cf-4e81-8d47-366f3b7ec653 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.288289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82aa268-65cf-4e81-8d47-366f3b7ec653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.288563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82aa268-65cf-4e81-8d47-366f3b7ec653 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.289255 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82aa268-65cf-4e81-8d47-366f3b7ec653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:00.291213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82aa268-65cf-4e81-8d47-366f3b7ec653 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:00.381272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 979/2005] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:00 2022] POST /identity/v3/users => generated 292 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:00.385619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbb523-c75d-42ee-bd4a-168081267e1e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:00.397346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbb523-c75d-42ee-bd4a-168081267e1e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:00.403738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73cc76-d60c-4ef5-903a-557eab92d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:00.404838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc76-d60c-4ef5-903a-557eab92d231 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.405792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc76-d60c-4ef5-903a-557eab92d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.406476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc76-d60c-4ef5-903a-557eab92d231 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.407667 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73cc76-d60c-4ef5-903a-557eab92d231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:00.410668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73cc76-d60c-4ef5-903a-557eab92d231 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:00.424225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 980/2006] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:00.428746 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73cc76-d60c-4ef5-903a-557eab92d231 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:00.440323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73cc76-d60c-4ef5-903a-557eab92d231 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:00.447495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49817063-f768-48ca-8883-7caa96302eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:00.448337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49817063-f768-48ca-8883-7caa96302eec admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.448621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49817063-f768-48ca-8883-7caa96302eec admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.448904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49817063-f768-48ca-8883-7caa96302eec admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.449630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49817063-f768-48ca-8883-7caa96302eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:00.451613 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49817063-f768-48ca-8883-7caa96302eec admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:00.464815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1027/2007] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:00 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:00.473117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 981/2008] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:00.477552 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82aa268-65cf-4e81-8d47-366f3b7ec653 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:00.479160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49817063-f768-48ca-8883-7caa96302eec admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:00.496531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49817063-f768-48ca-8883-7caa96302eec admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:00.599930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82aa268-65cf-4e81-8d47-366f3b7ec653 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:00.605946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372a498-586a-4d1c-91dd-c21fcb529088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:00.606747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372a498-586a-4d1c-91dd-c21fcb529088 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.607038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372a498-586a-4d1c-91dd-c21fcb529088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.607317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372a498-586a-4d1c-91dd-c21fcb529088 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.608220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372a498-586a-4d1c-91dd-c21fcb529088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:00.611732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372a498-586a-4d1c-91dd-c21fcb529088 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:00.642871 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c7713-1307-4894-94eb-89849a5b953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:00.644492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c7713-1307-4894-94eb-89849a5b953c admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.644839 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c7713-1307-4894-94eb-89849a5b953c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.646258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c7713-1307-4894-94eb-89849a5b953c admin admin] PATH_INFO: `/v3/projects/de4d2470d5374df0b7bad3a60b838d5c/users/84ce289863d64f248ef5d5b42e9f8097/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.669383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c7713-1307-4894-94eb-89849a5b953c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4d2470d5374df0b7bad3a60b838d5c, user_id=84ce289863d64f248ef5d5b42e9f8097, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:00.672192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c7713-1307-4894-94eb-89849a5b953c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:00.719716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1028/2009] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:00 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:00.721117 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372a498-586a-4d1c-91dd-c21fcb529088 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:00.731848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372a498-586a-4d1c-91dd-c21fcb529088 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:00.737164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda4a42-63d7-416c-b835-42d39f03ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:00.738031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4a42-63d7-416c-b835-42d39f03ea56 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.738366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4a42-63d7-416c-b835-42d39f03ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.738711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda4a42-63d7-416c-b835-42d39f03ea56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.739694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda4a42-63d7-416c-b835-42d39f03ea56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:00.741515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda4a42-63d7-416c-b835-42d39f03ea56 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:00.754115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1029/2010] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:00.760883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda4a42-63d7-416c-b835-42d39f03ea56 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:00.771601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda4a42-63d7-416c-b835-42d39f03ea56 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:00.777723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0949c3-244d-4340-98b4-0459c755bdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:00.778638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0949c3-244d-4340-98b4-0459c755bdfb admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.778918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0949c3-244d-4340-98b4-0459c755bdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.779190 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0949c3-244d-4340-98b4-0459c755bdfb admin admin] PATH_INFO: `/v3/projects/ce4b6026f23c401fada8c6bf9d816b61/users/901056bc07bf4a9f8be25c8aa753a389/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.795503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0949c3-244d-4340-98b4-0459c755bdfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4b6026f23c401fada8c6bf9d816b61, user_id=901056bc07bf4a9f8be25c8aa753a389, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:00.798509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0949c3-244d-4340-98b4-0459c755bdfb admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:00.808915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 982/2011] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:00 2022] PUT /identity/v3/projects/de4d2470d5374df0b7bad3a60b838d5c/users/84ce289863d64f248ef5d5b42e9f8097/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:00.830791 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a0471-20f5-415b-995d-fffd7db5f6de None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:00.831075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a0471-20f5-415b-995d-fffd7db5f6de None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:00.832037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a0471-20f5-415b-995d-fffd7db5f6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:00.863743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-df2a0471-20f5-415b-995d-fffd7db5f6de None None] MFA Rules not processed for user `84ce289863d64f248ef5d5b42e9f8097`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:00.864968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-df2a0471-20f5-415b-995d-fffd7db5f6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:00.938779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1030/2012] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:00 2022] PUT /identity/v3/projects/ce4b6026f23c401fada8c6bf9d816b61/users/901056bc07bf4a9f8be25c8aa753a389/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:00.944494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0949c3-244d-4340-98b4-0459c755bdfb admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:00.961559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 983/2013] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:00.966835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a0471-20f5-415b-995d-fffd7db5f6de None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:01.057901 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a0471-20f5-415b-995d-fffd7db5f6de None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:01.072616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ea366-916e-4643-974f-38b805cf37b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:01.072616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ea366-916e-4643-974f-38b805cf37b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.072616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ea366-916e-4643-974f-38b805cf37b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.072616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ea366-916e-4643-974f-38b805cf37b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.073534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ea366-916e-4643-974f-38b805cf37b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:01.073682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0949c3-244d-4340-98b4-0459c755bdfb admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:01.073759 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ea366-916e-4643-974f-38b805cf37b1 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:01.075680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89b943-6b06-4f4a-8eee-3ee0ae1d7096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:01.076394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89b943-6b06-4f4a-8eee-3ee0ae1d7096 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.076673 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89b943-6b06-4f4a-8eee-3ee0ae1d7096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.076947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89b943-6b06-4f4a-8eee-3ee0ae1d7096 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.078208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89b943-6b06-4f4a-8eee-3ee0ae1d7096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:01.079425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89b943-6b06-4f4a-8eee-3ee0ae1d7096 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:01.092278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1031/2014] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:01.097914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89b943-6b06-4f4a-8eee-3ee0ae1d7096 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:01.122584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89b943-6b06-4f4a-8eee-3ee0ae1d7096 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:01.131239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c5f17-38a7-476b-b0ee-ecf12665da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:01.132247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c5f17-38a7-476b-b0ee-ecf12665da40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.132609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c5f17-38a7-476b-b0ee-ecf12665da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.132959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c5f17-38a7-476b-b0ee-ecf12665da40 admin admin] PATH_INFO: `/v3/projects/ce4b6026f23c401fada8c6bf9d816b61/users/901056bc07bf4a9f8be25c8aa753a389/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.135256 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c5f17-38a7-476b-b0ee-ecf12665da40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4b6026f23c401fada8c6bf9d816b61, user_id=901056bc07bf4a9f8be25c8aa753a389, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:01.143564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c5f17-38a7-476b-b0ee-ecf12665da40 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:01.158091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1032/2015] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:01 2022] PUT /identity/v3/projects/ce4b6026f23c401fada8c6bf9d816b61/users/901056bc07bf4a9f8be25c8aa753a389/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:01.170777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2554b-cc6f-4ff7-87e5-a030ace07aa6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.173205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2554b-cc6f-4ff7-87e5-a030ace07aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.173499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2554b-cc6f-4ff7-87e5-a030ace07aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.209190 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-54e2554b-cc6f-4ff7-87e5-a030ace07aa6 None None] MFA Rules not processed for user `901056bc07bf4a9f8be25c8aa753a389`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:01.210033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 984/2016] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:00 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:01.210583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-54e2554b-cc6f-4ff7-87e5-a030ace07aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:01.214172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ea366-916e-4643-974f-38b805cf37b1 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:01.319161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1033/2017] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:01.332025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2554b-cc6f-4ff7-87e5-a030ace07aa6 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:01.332025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-54e2554b-cc6f-4ff7-87e5-a030ace07aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:01.333826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ea366-916e-4643-974f-38b805cf37b1 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:01.339278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca31af4-5713-4b15-afb8-1c12f85832f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:01.339972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca31af4-5713-4b15-afb8-1c12f85832f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.340308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca31af4-5713-4b15-afb8-1c12f85832f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.340738 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca31af4-5713-4b15-afb8-1c12f85832f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.341509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca31af4-5713-4b15-afb8-1c12f85832f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:01.344590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca31af4-5713-4b15-afb8-1c12f85832f2 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:01.413784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2554b-cc6f-4ff7-87e5-a030ace07aa6 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:01.420789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55571a74-c384-4216-8b5a-d26a9a83fca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:01.420789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55571a74-c384-4216-8b5a-d26a9a83fca7 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.420789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55571a74-c384-4216-8b5a-d26a9a83fca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.420789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55571a74-c384-4216-8b5a-d26a9a83fca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.451065 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 985/2018] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:01 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:01.451985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca31af4-5713-4b15-afb8-1c12f85832f2 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:01.467473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca31af4-5713-4b15-afb8-1c12f85832f2 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:01.477413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227b61e-a4bd-430c-bd36-c89ba3924a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:01.478306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227b61e-a4bd-430c-bd36-c89ba3924a1b admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.478571 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227b61e-a4bd-430c-bd36-c89ba3924a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.478847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227b61e-a4bd-430c-bd36-c89ba3924a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.479583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227b61e-a4bd-430c-bd36-c89ba3924a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:01.481185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227b61e-a4bd-430c-bd36-c89ba3924a1b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:01.485458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55571a74-c384-4216-8b5a-d26a9a83fca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:01.488787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55571a74-c384-4216-8b5a-d26a9a83fca7 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:01.493057 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 986/2019] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:01.498126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227b61e-a4bd-430c-bd36-c89ba3924a1b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:01.500429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1034/2020] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:57:01.511598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227b61e-a4bd-430c-bd36-c89ba3924a1b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:01.524117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aee84-513c-4a91-8f3c-c0f4477d5e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:01.525131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aee84-513c-4a91-8f3c-c0f4477d5e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.525506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aee84-513c-4a91-8f3c-c0f4477d5e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.525876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aee84-513c-4a91-8f3c-c0f4477d5e23 admin admin] PATH_INFO: `/v3/projects/d7a90dbcb7674e0f82abde7cf5b55a02/users/30fd65d19f69400eb89e35db5407d034/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.544405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aee84-513c-4a91-8f3c-c0f4477d5e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a90dbcb7674e0f82abde7cf5b55a02, user_id=30fd65d19f69400eb89e35db5407d034, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:01.549717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aee84-513c-4a91-8f3c-c0f4477d5e23 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:01.648540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 987/2021] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:01 2022] PUT /identity/v3/projects/d7a90dbcb7674e0f82abde7cf5b55a02/users/30fd65d19f69400eb89e35db5407d034/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:01.650181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55571a74-c384-4216-8b5a-d26a9a83fca7 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:01.666216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55571a74-c384-4216-8b5a-d26a9a83fca7 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:01.735335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70d14-d626-401f-b694-d2731125d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:01.736126 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70d14-d626-401f-b694-d2731125d839 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.736390 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70d14-d626-401f-b694-d2731125d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.736669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70d14-d626-401f-b694-d2731125d839 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.737467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70d14-d626-401f-b694-d2731125d839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:01.739860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70d14-d626-401f-b694-d2731125d839 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:01.750039 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1035/2022] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:01.754262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aee84-513c-4a91-8f3c-c0f4477d5e23 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:01.764413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aee84-513c-4a91-8f3c-c0f4477d5e23 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:01.769340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957068b6-5bc1-48d7-91c9-853949332c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:01.770255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957068b6-5bc1-48d7-91c9-853949332c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.770540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957068b6-5bc1-48d7-91c9-853949332c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.770816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957068b6-5bc1-48d7-91c9-853949332c27 admin admin] PATH_INFO: `/v3/projects/d7a90dbcb7674e0f82abde7cf5b55a02/users/30fd65d19f69400eb89e35db5407d034/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.772831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957068b6-5bc1-48d7-91c9-853949332c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a90dbcb7674e0f82abde7cf5b55a02, user_id=30fd65d19f69400eb89e35db5407d034, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:01.775646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957068b6-5bc1-48d7-91c9-853949332c27 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:01.794380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 988/2023] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:01 2022] PUT /identity/v3/projects/d7a90dbcb7674e0f82abde7cf5b55a02/users/30fd65d19f69400eb89e35db5407d034/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:01.804163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c9e9-c89a-4ead-8533-ca7469750772 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.804468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c9e9-c89a-4ead-8533-ca7469750772 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.804723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c9e9-c89a-4ead-8533-ca7469750772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.835188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b7e8c9e9-c89a-4ead-8533-ca7469750772 None None] MFA Rules not processed for user `30fd65d19f69400eb89e35db5407d034`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:01.835188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b7e8c9e9-c89a-4ead-8533-ca7469750772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:01.910733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1036/2024] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:01.922660 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957068b6-5bc1-48d7-91c9-853949332c27 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:01.924347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-957068b6-5bc1-48d7-91c9-853949332c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:01.983200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957068b6-5bc1-48d7-91c9-853949332c27 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:01.987090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1746f-1161-4388-9d4e-62bd382cf2eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:01.988411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1746f-1161-4388-9d4e-62bd382cf2eb service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:01.988835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1746f-1161-4388-9d4e-62bd382cf2eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:01.988939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1746f-1161-4388-9d4e-62bd382cf2eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:01.998828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1746f-1161-4388-9d4e-62bd382cf2eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:02.000462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1746f-1161-4388-9d4e-62bd382cf2eb service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:02.011138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 989/2025] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:02.298319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8c9e9-c89a-4ead-8533-ca7469750772 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:02.308074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8c9e9-c89a-4ead-8533-ca7469750772 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:02.311817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaf6b5-33e6-4625-92ca-ed7ba380faf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:02.312594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaf6b5-33e6-4625-92ca-ed7ba380faf4 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:02.312882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaf6b5-33e6-4625-92ca-ed7ba380faf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:02.313188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaf6b5-33e6-4625-92ca-ed7ba380faf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:02.387388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaf6b5-33e6-4625-92ca-ed7ba380faf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:02.388834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaf6b5-33e6-4625-92ca-ed7ba380faf4 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:02.399311 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1037/2026] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:02.959959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1746f-1161-4388-9d4e-62bd382cf2eb service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:03.031559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1746f-1161-4388-9d4e-62bd382cf2eb service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:03.036301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:03.041300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:03.041300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:03.041300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] PATH_INFO: `/v3/users/84ce289863d64f248ef5d5b42e9f8097` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:03.041300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ce289863d64f248ef5d5b42e9f8097)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:03.041300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:03.314792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ce289863d64f248ef5d5b42e9f8097'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:03.315536 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ce289863d64f248ef5d5b42e9f8097'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:03.389473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ce289863d64f248ef5d5b42e9f8097'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:03.397125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ce289863d64f248ef5d5b42e9f8097'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:03.408724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ce289863d64f248ef5d5b42e9f8097'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:03.415192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 990/2027] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:02 2022] DELETE /identity/v3/users/84ce289863d64f248ef5d5b42e9f8097 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:03.420108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebff651-efd4-44c2-b1d4-6063dca7431e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:03.420940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebff651-efd4-44c2-b1d4-6063dca7431e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:03.421216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebff651-efd4-44c2-b1d4-6063dca7431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:03.439346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0ebff651-efd4-44c2-b1d4-6063dca7431e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:03.440631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0ebff651-efd4-44c2-b1d4-6063dca7431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:03.510836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1038/2028] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:03.520907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:03.522367 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:03.577323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad80561-13a1-4642-a337-45654f2cc26c admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:03.580905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd6b31-1fd6-4a77-9ef1-c5d3a50fadcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:03.582151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd6b31-1fd6-4a77-9ef1-c5d3a50fadcc service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:03.582433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd6b31-1fd6-4a77-9ef1-c5d3a50fadcc service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:03.582757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd6b31-1fd6-4a77-9ef1-c5d3a50fadcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:03.592259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd6b31-1fd6-4a77-9ef1-c5d3a50fadcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:03.597799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd6b31-1fd6-4a77-9ef1-c5d3a50fadcc service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:03.608224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 991/2029] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:04.118516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebff651-efd4-44c2-b1d4-6063dca7431e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:04.120285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0ebff651-efd4-44c2-b1d4-6063dca7431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:04.134251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebff651-efd4-44c2-b1d4-6063dca7431e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:04.140490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:04.141713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:04.142414 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:04.142784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] PATH_INFO: `/v3/projects/de4d2470d5374df0b7bad3a60b838d5c` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:04.144069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4d2470d5374df0b7bad3a60b838d5c)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:04.146700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:04.302444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4d2470d5374df0b7bad3a60b838d5c', 'request_id': 'req-9fa84c6e-0738-43e9-a637-f10a1192336f'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:04.309916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4d2470d5374df0b7bad3a60b838d5c', 'request_id': 'req-9fa84c6e-0738-43e9-a637-f10a1192336f'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:04.407040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4d2470d5374df0b7bad3a60b838d5c', 'request_id': 'req-9fa84c6e-0738-43e9-a637-f10a1192336f'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:04.422376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] The token cache is being invalidate because project de4d2470d5374df0b7bad3a60b838d5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:04.423178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:04.423333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:04.424881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1039/2030] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:04 2022] DELETE /identity/v3/projects/de4d2470d5374df0b7bad3a60b838d5c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:04.429022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd6b31-1fd6-4a77-9ef1-c5d3a50fadcc service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:04.438975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd6b31-1fd6-4a77-9ef1-c5d3a50fadcc service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:04.506394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:04.506394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:04.506394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:04.506394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] PATH_INFO: `/v3/users/30fd65d19f69400eb89e35db5407d034` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:04.506841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] RBAC: Authorizing `identity:delete_user(user_id=30fd65d19f69400eb89e35db5407d034)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:04.506841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:04.708109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:04.709872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:04.725969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa84c6e-0738-43e9-a637-f10a1192336f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:04.733657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:04.734941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:04.735370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:04.735649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] PATH_INFO: `/v3/users/816a886c41a646f693e9fbf039e09c51` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:04.736870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816a886c41a646f693e9fbf039e09c51)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:04.739259 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:04.747265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30fd65d19f69400eb89e35db5407d034'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:04.748020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30fd65d19f69400eb89e35db5407d034'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:04.869929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30fd65d19f69400eb89e35db5407d034'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:04.877432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30fd65d19f69400eb89e35db5407d034'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:04.889756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2dfa2bb3-e2ab-49ca-ac18-8411a45c458e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30fd65d19f69400eb89e35db5407d034'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:04.896234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 992/2031] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:04 2022] DELETE /identity/v3/users/30fd65d19f69400eb89e35db5407d034 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:04.993239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816a886c41a646f693e9fbf039e09c51'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:05.001562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816a886c41a646f693e9fbf039e09c51'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:05.132653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816a886c41a646f693e9fbf039e09c51'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:05.154851 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816a886c41a646f693e9fbf039e09c51'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:05.155512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816a886c41a646f693e9fbf039e09c51'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:05.162083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1040/2032] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:04 2022] DELETE /identity/v3/users/816a886c41a646f693e9fbf039e09c51 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:05.170573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d7c91-89d0-4ec8-b5df-8c803b72d917 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:05.170889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d7c91-89d0-4ec8-b5df-8c803b72d917 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:05.171149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d7c91-89d0-4ec8-b5df-8c803b72d917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:05.190478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ed6d7c91-89d0-4ec8-b5df-8c803b72d917 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:05.192352 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ed6d7c91-89d0-4ec8-b5df-8c803b72d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:05.259072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 993/2033] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:05.268270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:05.270536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:05.330020 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b81770-f235-4662-87e0-78a1f5ebf2f3 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:05.334767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10e1d4-8342-48c8-ba1e-660da0113f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:05.335494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e1d4-8342-48c8-ba1e-660da0113f2d service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:05.335874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e1d4-8342-48c8-ba1e-660da0113f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:05.336224 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10e1d4-8342-48c8-ba1e-660da0113f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:05.346288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10e1d4-8342-48c8-ba1e-660da0113f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:05.348045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10e1d4-8342-48c8-ba1e-660da0113f2d service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:05.358224 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1041/2034] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:05.540757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d7c91-89d0-4ec8-b5df-8c803b72d917 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:05.543163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ed6d7c91-89d0-4ec8-b5df-8c803b72d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:05.562381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d7c91-89d0-4ec8-b5df-8c803b72d917 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:05.571753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:05.573769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:05.574276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:05.574947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] PATH_INFO: `/v3/projects/d7a90dbcb7674e0f82abde7cf5b55a02` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:05.576841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a90dbcb7674e0f82abde7cf5b55a02)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:05.579877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:05.742206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a90dbcb7674e0f82abde7cf5b55a02', 'request_id': 'req-adae1486-36a3-47fe-8a9e-404393884eee'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:05.749519 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a90dbcb7674e0f82abde7cf5b55a02', 'request_id': 'req-adae1486-36a3-47fe-8a9e-404393884eee'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:05.757002 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a90dbcb7674e0f82abde7cf5b55a02', 'request_id': 'req-adae1486-36a3-47fe-8a9e-404393884eee'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:05.886375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] The token cache is being invalidate because project d7a90dbcb7674e0f82abde7cf5b55a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:05.886732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:05.888962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:05.889317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 994/2035] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:05 2022] DELETE /identity/v3/projects/d7a90dbcb7674e0f82abde7cf5b55a02 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:05.894841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb5928-ca24-4e3b-af78-b2275cd6b944 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:05.895320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb5928-ca24-4e3b-af78-b2275cd6b944 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:05.895426 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb5928-ca24-4e3b-af78-b2275cd6b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:05.917537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-dcdb5928-ca24-4e3b-af78-b2275cd6b944 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:05.917537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-dcdb5928-ca24-4e3b-af78-b2275cd6b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:05.918767 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:05.920243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:05.981891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1042/2036] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:05.991946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1292-f887-4d32-a3ad-7400c3330d41 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:05.992240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1292-f887-4d32-a3ad-7400c3330d41 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:05.992520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1292-f887-4d32-a3ad-7400c3330d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:05.993184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae1486-36a3-47fe-8a9e-404393884eee admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:05.997982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:05.998913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:05.999214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:05.999520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] PATH_INFO: `/v3/projects/4344ec88553f421f843315c25ce06387` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:06.001491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4344ec88553f421f843315c25ce06387)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:06.004510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:06.012267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-34ac1292-f887-4d32-a3ad-7400c3330d41 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:06.013772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-34ac1292-f887-4d32-a3ad-7400c3330d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:06.024858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1043/2037] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:06.025728 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac1292-f887-4d32-a3ad-7400c3330d41 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:06.026981 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-34ac1292-f887-4d32-a3ad-7400c3330d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:06.039033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac1292-f887-4d32-a3ad-7400c3330d41 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:06.043940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:06.044965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:06.045255 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:06.045532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] PATH_INFO: `/v3/users/87bebd1c8b2a4e4c95e3345a3d558021` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:06.046775 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=87bebd1c8b2a4e4c95e3345a3d558021)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:06.048737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:06.172637 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4344ec88553f421f843315c25ce06387', 'request_id': 'req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.178865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4344ec88553f421f843315c25ce06387', 'request_id': 'req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.184319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4344ec88553f421f843315c25ce06387', 'request_id': 'req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.269685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] The token cache is being invalidate because project 4344ec88553f421f843315c25ce06387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:06.270034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.270679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.272302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 995/2038] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:05 2022] DELETE /identity/v3/projects/4344ec88553f421f843315c25ce06387 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:06.273786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:06.275255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:06.330610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87bebd1c8b2a4e4c95e3345a3d558021'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.337810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87bebd1c8b2a4e4c95e3345a3d558021'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.338932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b751cd6-2e32-4bd9-b3a6-aefdc152226f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:06.343904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21f124-5264-41b7-9096-276a1db5b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:06.344557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f124-5264-41b7-9096-276a1db5b786 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:06.347677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f124-5264-41b7-9096-276a1db5b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:06.347677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21f124-5264-41b7-9096-276a1db5b786 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:06.347677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21f124-5264-41b7-9096-276a1db5b786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:06.347677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21f124-5264-41b7-9096-276a1db5b786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:06.348014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21f124-5264-41b7-9096-276a1db5b786 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:06.359637 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 996/2039] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:06.360481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21f124-5264-41b7-9096-276a1db5b786 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:06.362157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8b21f124-5264-41b7-9096-276a1db5b786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:06.374862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21f124-5264-41b7-9096-276a1db5b786 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:06.380828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:06.381826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:06.382143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:06.382415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] PATH_INFO: `/v3/users/30d7907f5710467b97d8db0789fbfab2` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:06.383592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d7907f5710467b97d8db0789fbfab2)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:06.385463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:06.486923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87bebd1c8b2a4e4c95e3345a3d558021'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.499673 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87bebd1c8b2a4e4c95e3345a3d558021'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.500349 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87bebd1c8b2a4e4c95e3345a3d558021'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.506734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1044/2040] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:06 2022] DELETE /identity/v3/users/87bebd1c8b2a4e4c95e3345a3d558021 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:06.507509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:06.508808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:06.573583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89887b-ae18-4a5d-9186-af3d06db34ed admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:06.578389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:06.579411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:06.579537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:06.579779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] PATH_INFO: `/v3/users/2f10de3b7d6b492fb9a4aee600ae634c` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:06.581025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f10de3b7d6b492fb9a4aee600ae634c)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:06.583169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:06.608701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d7907f5710467b97d8db0789fbfab2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.609345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d7907f5710467b97d8db0789fbfab2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.747608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d7907f5710467b97d8db0789fbfab2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.751851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d7907f5710467b97d8db0789fbfab2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.763964 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d7907f5710467b97d8db0789fbfab2'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.770122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 997/2041] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:06 2022] DELETE /identity/v3/users/30d7907f5710467b97d8db0789fbfab2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:06.773167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:06.773167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:06.836122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a311b-026b-4e40-804f-01cc6884f396 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:06.841413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73053443-239d-4086-99cf-3009dfc02489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:06.842107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053443-239d-4086-99cf-3009dfc02489 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:06.842386 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053443-239d-4086-99cf-3009dfc02489 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:06.842656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053443-239d-4086-99cf-3009dfc02489 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:06.843335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73053443-239d-4086-99cf-3009dfc02489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:06.845231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73053443-239d-4086-99cf-3009dfc02489 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:06.890129 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f10de3b7d6b492fb9a4aee600ae634c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.897271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f10de3b7d6b492fb9a4aee600ae634c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:06.997303 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 998/2042] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:06 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:06.998785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb363324-7abb-4df7-9aa2-1453e1793cc8 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:06.999017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb363324-7abb-4df7-9aa2-1453e1793cc8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:06.999292 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb363324-7abb-4df7-9aa2-1453e1793cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.017220 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-fb363324-7abb-4df7-9aa2-1453e1793cc8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:07.018441 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fb363324-7abb-4df7-9aa2-1453e1793cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:07.024088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f10de3b7d6b492fb9a4aee600ae634c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:07.038333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f10de3b7d6b492fb9a4aee600ae634c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:07.039057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c11807a6-a74e-4996-b69e-52e5717ee23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f10de3b7d6b492fb9a4aee600ae634c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:07.045085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1045/2043] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:06 2022] DELETE /identity/v3/users/2f10de3b7d6b492fb9a4aee600ae634c => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:07.046664 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8637-3846-49d0-9d0b-84a1a9f245fb None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:07.047157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8637-3846-49d0-9d0b-84a1a9f245fb None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:07.047632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d8637-3846-49d0-9d0b-84a1a9f245fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.070560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b07d8637-3846-49d0-9d0b-84a1a9f245fb None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:07.070560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b07d8637-3846-49d0-9d0b-84a1a9f245fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:07.090258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 999/2044] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:07.091149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb363324-7abb-4df7-9aa2-1453e1793cc8 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:07.092446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fb363324-7abb-4df7-9aa2-1453e1793cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:07.105032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb363324-7abb-4df7-9aa2-1453e1793cc8 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:07.141771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1046/2045] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:07.142932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d8637-3846-49d0-9d0b-84a1a9f245fb None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:07.144900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b07d8637-3846-49d0-9d0b-84a1a9f245fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:07.177871 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892559f-ca6b-4b3d-a280-e90ba9751bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:07.178674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892559f-ca6b-4b3d-a280-e90ba9751bbb admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:07.178961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892559f-ca6b-4b3d-a280-e90ba9751bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:07.179239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892559f-ca6b-4b3d-a280-e90ba9751bbb admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.179936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892559f-ca6b-4b3d-a280-e90ba9751bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:07.181876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892559f-ca6b-4b3d-a280-e90ba9751bbb admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:07.209933 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d8637-3846-49d0-9d0b-84a1a9f245fb None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:07.213911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaede2ec-2d01-41bc-93f4-97b5eb3f3cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:07.214593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaede2ec-2d01-41bc-93f4-97b5eb3f3cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:07.214856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaede2ec-2d01-41bc-93f4-97b5eb3f3cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:07.215156 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaede2ec-2d01-41bc-93f4-97b5eb3f3cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.225663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaede2ec-2d01-41bc-93f4-97b5eb3f3cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:07.227298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaede2ec-2d01-41bc-93f4-97b5eb3f3cb6 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:07.238615 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1047/2046] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:07.239436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaede2ec-2d01-41bc-93f4-97b5eb3f3cb6 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:07.247377 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaede2ec-2d01-41bc-93f4-97b5eb3f3cb6 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:07.254599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e8acd-97e1-46a6-a535-41b75b580e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:07.255253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e8acd-97e1-46a6-a535-41b75b580e1b service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:07.255535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e8acd-97e1-46a6-a535-41b75b580e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:07.255807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e8acd-97e1-46a6-a535-41b75b580e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.263039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1000/2047] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:07 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:07.267933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892559f-ca6b-4b3d-a280-e90ba9751bbb admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:07.271062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e8acd-97e1-46a6-a535-41b75b580e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:07.272881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e8acd-97e1-46a6-a535-41b75b580e1b service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:07.288375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1048/2048] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:07.298707 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892559f-ca6b-4b3d-a280-e90ba9751bbb admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:07.305767 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa213f7d-752e-40b4-9434-91b2997b95dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:07.306772 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa213f7d-752e-40b4-9434-91b2997b95dc admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:07.306953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa213f7d-752e-40b4-9434-91b2997b95dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:07.307599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa213f7d-752e-40b4-9434-91b2997b95dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.308007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa213f7d-752e-40b4-9434-91b2997b95dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:07.309624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa213f7d-752e-40b4-9434-91b2997b95dc admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:07.321932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1001/2049] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:07.326203 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e8acd-97e1-46a6-a535-41b75b580e1b service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:07.338024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e8acd-97e1-46a6-a535-41b75b580e1b service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:07.344465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3172a57-2261-4c5d-9f38-001e32f33ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:07.345130 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3172a57-2261-4c5d-9f38-001e32f33ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:07.346132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3172a57-2261-4c5d-9f38-001e32f33ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:07.346132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3172a57-2261-4c5d-9f38-001e32f33ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.346493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3172a57-2261-4c5d-9f38-001e32f33ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:07.348507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3172a57-2261-4c5d-9f38-001e32f33ac0 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:07.362045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1049/2050] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:07.364733 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa213f7d-752e-40b4-9434-91b2997b95dc admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:07.377411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa213f7d-752e-40b4-9434-91b2997b95dc admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:07.384541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f696ee-a59b-495f-a1d1-3496e9e7560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:07.385601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f696ee-a59b-495f-a1d1-3496e9e7560d admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:07.385888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f696ee-a59b-495f-a1d1-3496e9e7560d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:07.386264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f696ee-a59b-495f-a1d1-3496e9e7560d admin admin] PATH_INFO: `/v3/projects/98c7dc4f8d6740a996ee58a2acd96914/users/0541074243c74c848d92f59f9f7ffcae/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.403273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f696ee-a59b-495f-a1d1-3496e9e7560d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c7dc4f8d6740a996ee58a2acd96914, user_id=0541074243c74c848d92f59f9f7ffcae, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:07.405984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f696ee-a59b-495f-a1d1-3496e9e7560d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:07.495913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1002/2051] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:07 2022] PUT /identity/v3/projects/98c7dc4f8d6740a996ee58a2acd96914/users/0541074243c74c848d92f59f9f7ffcae/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:07.496068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3172a57-2261-4c5d-9f38-001e32f33ac0 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:07.499120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a3172a57-2261-4c5d-9f38-001e32f33ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:07.507398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ad315-a2cb-4da4-b9e3-836e0978a9dd None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:07.507773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ad315-a2cb-4da4-b9e3-836e0978a9dd None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:07.508174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ad315-a2cb-4da4-b9e3-836e0978a9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.551343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3172a57-2261-4c5d-9f38-001e32f33ac0 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:07.589205 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1d0ad315-a2cb-4da4-b9e3-836e0978a9dd None None] MFA Rules not processed for user `0541074243c74c848d92f59f9f7ffcae`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:07.590587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1d0ad315-a2cb-4da4-b9e3-836e0978a9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:07.687253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:07.687253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:07.687253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:07.687253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] PATH_INFO: `/v3/projects/767dbd54817a4dc49f66b30f46919e54` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.687609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=767dbd54817a4dc49f66b30f46919e54)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:07.687609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:07.698168 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1003/2052] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:07.699161 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ad315-a2cb-4da4-b9e3-836e0978a9dd None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:07.712431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ad315-a2cb-4da4-b9e3-836e0978a9dd None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:07.717881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4558b1-f6e5-4a19-9159-f11fbb7e6cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:07.718762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4558b1-f6e5-4a19-9159-f11fbb7e6cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:07.719054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4558b1-f6e5-4a19-9159-f11fbb7e6cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:07.719339 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4558b1-f6e5-4a19-9159-f11fbb7e6cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:07.720034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4558b1-f6e5-4a19-9159-f11fbb7e6cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:07.722620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4558b1-f6e5-4a19-9159-f11fbb7e6cf6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:07.886709 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767dbd54817a4dc49f66b30f46919e54', 'request_id': 'req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:07.893306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767dbd54817a4dc49f66b30f46919e54', 'request_id': 'req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:07.917275 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1004/2053] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:07 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:07.918493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4558b1-f6e5-4a19-9159-f11fbb7e6cf6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:07.920803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2b4558b1-f6e5-4a19-9159-f11fbb7e6cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:07.979231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767dbd54817a4dc49f66b30f46919e54', 'request_id': 'req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:07.992596 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] The token cache is being invalidate because project 767dbd54817a4dc49f66b30f46919e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:07.992891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:07.993562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:07.995843 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1050/2054] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:07 2022] DELETE /identity/v3/projects/767dbd54817a4dc49f66b30f46919e54 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:07.996923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:07.998337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:08.012610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4558b1-f6e5-4a19-9159-f11fbb7e6cf6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:08.017796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:08.019247 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:08.019575 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:08.020013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] PATH_INFO: `/v3/projects/4ea35541895a489ea2a4d4962d9ba2f1` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:08.021341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea35541895a489ea2a4d4962d9ba2f1)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:08.029918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:08.068806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c8ce7-6f98-4ebf-bbce-6f3aafbae6ee admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:08.081883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:08.081883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:08.081883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:08.081883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] PATH_INFO: `/v3/projects/c4cef706a1b94c96b53b990aafada997` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:08.082471 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4cef706a1b94c96b53b990aafada997)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:08.082471 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:08.259289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4cef706a1b94c96b53b990aafada997', 'request_id': 'req-27ea147c-80cf-4909-9fd2-e2d2e4eea927'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.265828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4cef706a1b94c96b53b990aafada997', 'request_id': 'req-27ea147c-80cf-4909-9fd2-e2d2e4eea927'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.266965 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea35541895a489ea2a4d4962d9ba2f1', 'request_id': 'req-e2372c93-8915-46ee-895e-8135180fd17f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.273851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea35541895a489ea2a4d4962d9ba2f1', 'request_id': 'req-e2372c93-8915-46ee-895e-8135180fd17f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.279451 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea35541895a489ea2a4d4962d9ba2f1', 'request_id': 'req-e2372c93-8915-46ee-895e-8135180fd17f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.320743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4cef706a1b94c96b53b990aafada997', 'request_id': 'req-27ea147c-80cf-4909-9fd2-e2d2e4eea927'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.332044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] The token cache is being invalidate because project c4cef706a1b94c96b53b990aafada997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:08.332340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.332979 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.334580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1051/2055] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:07 2022] DELETE /identity/v3/projects/c4cef706a1b94c96b53b990aafada997 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:08.335499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:08.336773 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:08.400904 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea147c-80cf-4909-9fd2-e2d2e4eea927 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:08.417296 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] The token cache is being invalidate because project 4ea35541895a489ea2a4d4962d9ba2f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:08.417588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.418403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e2372c93-8915-46ee-895e-8135180fd17f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.420019 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1005/2056] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:07 2022] DELETE /identity/v3/projects/4ea35541895a489ea2a4d4962d9ba2f1 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:08.424146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a5971-268f-43de-9159-3c3be3e36fce None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:08.424429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a5971-268f-43de-9159-3c3be3e36fce None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:08.424705 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a5971-268f-43de-9159-3c3be3e36fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:08.444237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-db8a5971-268f-43de-9159-3c3be3e36fce None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:08.445477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-db8a5971-268f-43de-9159-3c3be3e36fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:08.457906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a21fa0-9e38-4833-9052-a1f9089736eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:08.458597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a21fa0-9e38-4833-9052-a1f9089736eb admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:08.458877 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a21fa0-9e38-4833-9052-a1f9089736eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:08.459141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a21fa0-9e38-4833-9052-a1f9089736eb admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:08.459846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a21fa0-9e38-4833-9052-a1f9089736eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:08.461732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a21fa0-9e38-4833-9052-a1f9089736eb admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:08.509195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1006/2057] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:08.510442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a5971-268f-43de-9159-3c3be3e36fce None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:08.511794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-db8a5971-268f-43de-9159-3c3be3e36fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:08.524388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a5971-268f-43de-9159-3c3be3e36fce None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:08.529469 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:08.535014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:08.535014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:08.535014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] PATH_INFO: `/v3/users/901056bc07bf4a9f8be25c8aa753a389` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:08.535014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=901056bc07bf4a9f8be25c8aa753a389)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:08.535014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:08.561351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1052/2058] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:08 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:08.562206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a21fa0-9e38-4833-9052-a1f9089736eb admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:08.563771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-11a21fa0-9e38-4833-9052-a1f9089736eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:08.575694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a21fa0-9e38-4833-9052-a1f9089736eb admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:08.580952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:08.582181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:08.582473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:08.582725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] PATH_INFO: `/v3/users/0111d4fa43734aae8d2b15e9e7eb0af2` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:08.583975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0111d4fa43734aae8d2b15e9e7eb0af2)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:08.585885 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:08.754756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901056bc07bf4a9f8be25c8aa753a389'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.755409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901056bc07bf4a9f8be25c8aa753a389'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.779837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0111d4fa43734aae8d2b15e9e7eb0af2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.787175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0111d4fa43734aae8d2b15e9e7eb0af2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.875504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901056bc07bf4a9f8be25c8aa753a389'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.882990 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901056bc07bf4a9f8be25c8aa753a389'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.895417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fb1140c3-7b10-4a38-963c-29f164b9fb79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901056bc07bf4a9f8be25c8aa753a389'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.901217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1007/2059] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:08 2022] DELETE /identity/v3/users/901056bc07bf4a9f8be25c8aa753a389 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:08.902606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2d58f-6a0c-4b3f-b3ad-2d505ed73c29 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:08.902891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2d58f-6a0c-4b3f-b3ad-2d505ed73c29 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:08.903171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2d58f-6a0c-4b3f-b3ad-2d505ed73c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:08.921029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-74c2d58f-6a0c-4b3f-b3ad-2d505ed73c29 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:08.922295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-74c2d58f-6a0c-4b3f-b3ad-2d505ed73c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:08.961634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0111d4fa43734aae8d2b15e9e7eb0af2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.987009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0111d4fa43734aae8d2b15e9e7eb0af2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.990467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0111d4fa43734aae8d2b15e9e7eb0af2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:08.990642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1008/2060] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:08.991568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2d58f-6a0c-4b3f-b3ad-2d505ed73c29 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:08.992933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-74c2d58f-6a0c-4b3f-b3ad-2d505ed73c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:09.002455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1053/2061] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:08 2022] DELETE /identity/v3/users/0111d4fa43734aae8d2b15e9e7eb0af2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:09.003911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.006582 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:09.013597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2d58f-6a0c-4b3f-b3ad-2d505ed73c29 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.073445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909d746-f6c2-4f33-98b3-ddae156bfd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.077939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909d746-f6c2-4f33-98b3-ddae156bfd15 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.077939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909d746-f6c2-4f33-98b3-ddae156bfd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.077939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909d746-f6c2-4f33-98b3-ddae156bfd15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.077939 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909d746-f6c2-4f33-98b3-ddae156bfd15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.078381 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f5c68-129a-4878-a765-47c1ed0ea415 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.078489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909d746-f6c2-4f33-98b3-ddae156bfd15 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.081835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8497-e4bf-4080-b41b-2b82a1eec4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.082763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8497-e4bf-4080-b41b-2b82a1eec4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.083391 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8497-e4bf-4080-b41b-2b82a1eec4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.083737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8497-e4bf-4080-b41b-2b82a1eec4b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.084474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b8497-e4bf-4080-b41b-2b82a1eec4b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:09.084776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b8497-e4bf-4080-b41b-2b82a1eec4b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.086536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b8497-e4bf-4080-b41b-2b82a1eec4b9 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.088693 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1009/2062] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:09.093520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909d746-f6c2-4f33-98b3-ddae156bfd15 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.095429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9909d746-f6c2-4f33-98b3-ddae156bfd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:09.103226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1054/2063] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:09.107526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8497-e4bf-4080-b41b-2b82a1eec4b9 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.121022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909d746-f6c2-4f33-98b3-ddae156bfd15 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.122379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8497-e4bf-4080-b41b-2b82a1eec4b9 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.127772 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711e2d9-6d2c-4259-b7af-a612d5940420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.129719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711e2d9-6d2c-4259-b7af-a612d5940420 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.130203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711e2d9-6d2c-4259-b7af-a612d5940420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.130531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711e2d9-6d2c-4259-b7af-a612d5940420 admin admin] PATH_INFO: `/v3/projects/4292f432c2a44160be375593108ff2fa/users/d72a4b2fcf274f609a7aa8a8aab1c09a/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.131347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a141f-9797-4de8-a3e9-2f88674fc3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.132188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a141f-9797-4de8-a3e9-2f88674fc3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.132619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a141f-9797-4de8-a3e9-2f88674fc3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.133211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a141f-9797-4de8-a3e9-2f88674fc3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.134100 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a141f-9797-4de8-a3e9-2f88674fc3d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.136845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a141f-9797-4de8-a3e9-2f88674fc3d5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.151463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711e2d9-6d2c-4259-b7af-a612d5940420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4292f432c2a44160be375593108ff2fa, user_id=d72a4b2fcf274f609a7aa8a8aab1c09a, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.155804 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711e2d9-6d2c-4259-b7af-a612d5940420 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.290029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1010/2064] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:09 2022] PUT /identity/v3/projects/4292f432c2a44160be375593108ff2fa/users/d72a4b2fcf274f609a7aa8a8aab1c09a/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:09.294012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711e2d9-6d2c-4259-b7af-a612d5940420 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.295351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1055/2065] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:09 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:09.296248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a141f-9797-4de8-a3e9-2f88674fc3d5 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.369594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a141f-9797-4de8-a3e9-2f88674fc3d5 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.374409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da354ff-4313-4aa2-bb94-4adbe9e1ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.375057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da354ff-4313-4aa2-bb94-4adbe9e1ac36 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.375340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da354ff-4313-4aa2-bb94-4adbe9e1ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.375612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da354ff-4313-4aa2-bb94-4adbe9e1ac36 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.376314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da354ff-4313-4aa2-bb94-4adbe9e1ac36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.378423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da354ff-4313-4aa2-bb94-4adbe9e1ac36 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.380294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711e2d9-6d2c-4259-b7af-a612d5940420 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.385711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076dba8-a1ee-4f8b-b827-8ddfab7d750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.390069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076dba8-a1ee-4f8b-b827-8ddfab7d750b admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.390069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076dba8-a1ee-4f8b-b827-8ddfab7d750b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.390069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076dba8-a1ee-4f8b-b827-8ddfab7d750b admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.390069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076dba8-a1ee-4f8b-b827-8ddfab7d750b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.390069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076dba8-a1ee-4f8b-b827-8ddfab7d750b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.400049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1011/2066] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:09.404190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076dba8-a1ee-4f8b-b827-8ddfab7d750b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.414535 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076dba8-a1ee-4f8b-b827-8ddfab7d750b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.426904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c8e6f-f302-44d1-9475-333f15b98a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.426904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c8e6f-f302-44d1-9475-333f15b98a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.426904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c8e6f-f302-44d1-9475-333f15b98a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.426904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c8e6f-f302-44d1-9475-333f15b98a14 admin admin] PATH_INFO: `/v3/projects/4292f432c2a44160be375593108ff2fa/users/d72a4b2fcf274f609a7aa8a8aab1c09a/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.427215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c8e6f-f302-44d1-9475-333f15b98a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4292f432c2a44160be375593108ff2fa, user_id=d72a4b2fcf274f609a7aa8a8aab1c09a, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.427215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c8e6f-f302-44d1-9475-333f15b98a14 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.439059 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1012/2067] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:09 2022] PUT /identity/v3/projects/4292f432c2a44160be375593108ff2fa/users/d72a4b2fcf274f609a7aa8a8aab1c09a/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:09.440048 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c8e6f-f302-44d1-9475-333f15b98a14 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.442411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-be0c8e6f-f302-44d1-9475-333f15b98a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:09.501278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1056/2068] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:09 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:09.501278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eaf92-429d-4112-8106-59eaa7d56279 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.501278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eaf92-429d-4112-8106-59eaa7d56279 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.501278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60eaf92-429d-4112-8106-59eaa7d56279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.511559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c8e6f-f302-44d1-9475-333f15b98a14 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.516662 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.517528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.517809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.518433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] PATH_INFO: `/v3/projects/ce4b6026f23c401fada8c6bf9d816b61` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.520121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4b6026f23c401fada8c6bf9d816b61)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.522041 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.526441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-f60eaf92-429d-4112-8106-59eaa7d56279 None None] MFA Rules not processed for user `d72a4b2fcf274f609a7aa8a8aab1c09a`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:09.527657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f60eaf92-429d-4112-8106-59eaa7d56279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:09.596715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1057/2069] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:09.597671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eaf92-429d-4112-8106-59eaa7d56279 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.608342 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60eaf92-429d-4112-8106-59eaa7d56279 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.613520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7b33b-1150-4b14-8be2-56445a7a1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.614230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b33b-1150-4b14-8be2-56445a7a1b3c admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.614509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b33b-1150-4b14-8be2-56445a7a1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.614778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b33b-1150-4b14-8be2-56445a7a1b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.615494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7b33b-1150-4b14-8be2-56445a7a1b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.617140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7b33b-1150-4b14-8be2-56445a7a1b3c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.627613 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1058/2070] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:09.629022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7b33b-1150-4b14-8be2-56445a7a1b3c admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.630880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-baa7b33b-1150-4b14-8be2-56445a7a1b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:09.637916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4b6026f23c401fada8c6bf9d816b61', 'request_id': 'req-d2e7bf13-5131-439a-93d3-757d6f8ab245'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:09.643164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7b33b-1150-4b14-8be2-56445a7a1b3c admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.644299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4b6026f23c401fada8c6bf9d816b61', 'request_id': 'req-d2e7bf13-5131-439a-93d3-757d6f8ab245'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:09.649703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4b6026f23c401fada8c6bf9d816b61', 'request_id': 'req-d2e7bf13-5131-439a-93d3-757d6f8ab245'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:09.697768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.698688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.698967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.699266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] PATH_INFO: `/v3/projects/6cee9d19db9d4e64a27e46896abd4270` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.700537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cee9d19db9d4e64a27e46896abd4270)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.702610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.719904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] The token cache is being invalidate because project ce4b6026f23c401fada8c6bf9d816b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:09.720188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:09.720827 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:09.723297 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1013/2071] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:09 2022] DELETE /identity/v3/projects/ce4b6026f23c401fada8c6bf9d816b61 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:09.723959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.725148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:09.815381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7bf13-5131-439a-93d3-757d6f8ab245 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.820448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d60757-6373-436c-a1d9-b09542d09742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.821206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d60757-6373-436c-a1d9-b09542d09742 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.821556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d60757-6373-436c-a1d9-b09542d09742 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.821900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d60757-6373-436c-a1d9-b09542d09742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.824045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e4d60757-6373-436c-a1d9-b09542d09742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:09.842585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cee9d19db9d4e64a27e46896abd4270', 'request_id': 'req-2d3541d5-f7cb-43a5-8874-ed2076200fa1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:09.850288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cee9d19db9d4e64a27e46896abd4270', 'request_id': 'req-2d3541d5-f7cb-43a5-8874-ed2076200fa1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:09.892072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d60757-6373-436c-a1d9-b09542d09742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.893567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d60757-6373-436c-a1d9-b09542d09742 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:09.903714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1014/2072] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:09.904681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d60757-6373-436c-a1d9-b09542d09742 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.906074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e4d60757-6373-436c-a1d9-b09542d09742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:09.920906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d60757-6373-436c-a1d9-b09542d09742 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:09.949634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cee9d19db9d4e64a27e46896abd4270', 'request_id': 'req-2d3541d5-f7cb-43a5-8874-ed2076200fa1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:09.962099 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] The token cache is being invalidate because project 6cee9d19db9d4e64a27e46896abd4270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:09.962460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:09.963828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:09.965905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1059/2073] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:09 2022] DELETE /identity/v3/projects/6cee9d19db9d4e64a27e46896abd4270 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:09.970024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:09.971516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:09.983517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fca917-5fb6-4414-a81b-5a40da2333b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:09.984235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fca917-5fb6-4414-a81b-5a40da2333b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:09.984527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fca917-5fb6-4414-a81b-5a40da2333b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:09.984854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fca917-5fb6-4414-a81b-5a40da2333b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:09.985588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fca917-5fb6-4414-a81b-5a40da2333b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:09.987258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fca917-5fb6-4414-a81b-5a40da2333b6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:10.000776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1015/2074] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:10.001889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fca917-5fb6-4414-a81b-5a40da2333b6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:10.004320 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c5fca917-5fb6-4414-a81b-5a40da2333b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:10.017914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fca917-5fb6-4414-a81b-5a40da2333b6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:10.024748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf252b-12a0-4cef-bf63-68650c237d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:10.026532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf252b-12a0-4cef-bf63-68650c237d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:10.026860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf252b-12a0-4cef-bf63-68650c237d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:10.027143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf252b-12a0-4cef-bf63-68650c237d29 admin admin] PATH_INFO: `/v3/projects/9b564f6c4fde4830a745ca8097ef0429/users/fdd1b5488fc942898b39293d0758eb2f/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:10.044214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf252b-12a0-4cef-bf63-68650c237d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b564f6c4fde4830a745ca8097ef0429, user_id=fdd1b5488fc942898b39293d0758eb2f, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:10.044518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3541d5-f7cb-43a5-8874-ed2076200fa1 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:10.047418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf252b-12a0-4cef-bf63-68650c237d29 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:10.050032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:10.051033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:10.051316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:10.051591 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] PATH_INFO: `/v3/users/4ef011d5fe374f6598516b4f3e25bfc9` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:10.052866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef011d5fe374f6598516b4f3e25bfc9)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:10.054780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:10.118535 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1016/2075] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:10 2022] PUT /identity/v3/projects/9b564f6c4fde4830a745ca8097ef0429/users/fdd1b5488fc942898b39293d0758eb2f/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:10.129178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73289-c256-42d7-bddb-6c59eebe2a0c None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:10.129539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73289-c256-42d7-bddb-6c59eebe2a0c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:10.130044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73289-c256-42d7-bddb-6c59eebe2a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:10.157039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-23d73289-c256-42d7-bddb-6c59eebe2a0c None None] MFA Rules not processed for user `fdd1b5488fc942898b39293d0758eb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:10.158290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-23d73289-c256-42d7-bddb-6c59eebe2a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:10.220702 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef011d5fe374f6598516b4f3e25bfc9'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:10.225924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1017/2076] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:10.228059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef011d5fe374f6598516b4f3e25bfc9'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:10.334320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef011d5fe374f6598516b4f3e25bfc9'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:10.347531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef011d5fe374f6598516b4f3e25bfc9'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:10.348337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef011d5fe374f6598516b4f3e25bfc9'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:10.354649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1060/2077] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:09 2022] DELETE /identity/v3/users/4ef011d5fe374f6598516b4f3e25bfc9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:10.629837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d73289-c256-42d7-bddb-6c59eebe2a0c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:10.631362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-23d73289-c256-42d7-bddb-6c59eebe2a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:10.690078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d73289-c256-42d7-bddb-6c59eebe2a0c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:10.753888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba8205-f351-4d71-bea3-c6995fba06ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:10.754701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba8205-f351-4d71-bea3-c6995fba06ab service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:10.754881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba8205-f351-4d71-bea3-c6995fba06ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:10.755183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba8205-f351-4d71-bea3-c6995fba06ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:10.757095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-92ba8205-f351-4d71-bea3-c6995fba06ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:10.809575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:10.812510 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:10.840104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba8205-f351-4d71-bea3-c6995fba06ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:10.841620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba8205-f351-4d71-bea3-c6995fba06ab service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:10.858344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1018/2078] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:10.880272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba8205-f351-4d71-bea3-c6995fba06ab service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:10.881927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-92ba8205-f351-4d71-bea3-c6995fba06ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:10.938591 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4461a17-e291-4039-aa9e-c1b7beb4fb22 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:10.944008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:10.944868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:10.945240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:10.945515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] PATH_INFO: `/v3/projects/49c00704d70848918498cadd3a55dce2` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:10.946819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c00704d70848918498cadd3a55dce2)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:10.955990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:10.957433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba8205-f351-4d71-bea3-c6995fba06ab service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:10.964943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:10.971801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:10.971801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:10.971801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] PATH_INFO: `/v3/users/fdd1b5488fc942898b39293d0758eb2f` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:10.971801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd1b5488fc942898b39293d0758eb2f)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:10.971801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:11.058043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c00704d70848918498cadd3a55dce2', 'request_id': 'req-4c8286b5-caba-498c-8a5f-bf3b188821c3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:11.064089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c00704d70848918498cadd3a55dce2', 'request_id': 'req-4c8286b5-caba-498c-8a5f-bf3b188821c3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:11.172859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c00704d70848918498cadd3a55dce2', 'request_id': 'req-4c8286b5-caba-498c-8a5f-bf3b188821c3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:11.184234 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] The token cache is being invalidate because project 49c00704d70848918498cadd3a55dce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:11.184525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:11.185163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4c8286b5-caba-498c-8a5f-bf3b188821c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:11.186425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd1b5488fc942898b39293d0758eb2f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:11.187015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1061/2079] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:10 2022] DELETE /identity/v3/projects/49c00704d70848918498cadd3a55dce2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:11.187127 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd1b5488fc942898b39293d0758eb2f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:11.192809 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87fb8-a0da-4eb3-9fe6-9de65442f79c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.193095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87fb8-a0da-4eb3-9fe6-9de65442f79c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.193399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af87fb8-a0da-4eb3-9fe6-9de65442f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.211535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-5af87fb8-a0da-4eb3-9fe6-9de65442f79c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:11.212727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5af87fb8-a0da-4eb3-9fe6-9de65442f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:11.263642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd1b5488fc942898b39293d0758eb2f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:11.271443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd1b5488fc942898b39293d0758eb2f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:11.271575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1062/2080] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:11.281017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145cd3-ca33-4e80-b43c-3785e755883e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.281300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145cd3-ca33-4e80-b43c-3785e755883e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.281571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40145cd3-ca33-4e80-b43c-3785e755883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.284277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c157aed5-df16-4034-a4bb-afd444db2348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd1b5488fc942898b39293d0758eb2f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:11.290925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1019/2081] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:10 2022] DELETE /identity/v3/users/fdd1b5488fc942898b39293d0758eb2f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:11.295947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dddad-95b6-4bcb-8f3d-358d5c3e3442 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.296233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dddad-95b6-4bcb-8f3d-358d5c3e3442 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.296511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dddad-95b6-4bcb-8f3d-358d5c3e3442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.301643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-40145cd3-ca33-4e80-b43c-3785e755883e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:11.302868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-40145cd3-ca33-4e80-b43c-3785e755883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:11.313348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-2a7dddad-95b6-4bcb-8f3d-358d5c3e3442 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:11.314631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2a7dddad-95b6-4bcb-8f3d-358d5c3e3442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:11.363791 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1063/2082] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:11.368022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145cd3-ca33-4e80-b43c-3785e755883e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:11.374200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1020/2083] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:11.376968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40145cd3-ca33-4e80-b43c-3785e755883e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:11.382595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296125cc-b530-4577-b817-b2178a6c94b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:11.383251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296125cc-b530-4577-b817-b2178a6c94b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.383537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296125cc-b530-4577-b817-b2178a6c94b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.383814 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296125cc-b530-4577-b817-b2178a6c94b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.391589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296125cc-b530-4577-b817-b2178a6c94b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:11.391714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dddad-95b6-4bcb-8f3d-358d5c3e3442 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:11.391804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296125cc-b530-4577-b817-b2178a6c94b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:11.391884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2a7dddad-95b6-4bcb-8f3d-358d5c3e3442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:11.391965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296125cc-b530-4577-b817-b2178a6c94b1 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:11.399011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1064/2084] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:57:11.403488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296125cc-b530-4577-b817-b2178a6c94b1 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:11.412985 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296125cc-b530-4577-b817-b2178a6c94b1 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:11.417835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcf11b-fc7d-4a4b-9ff5-621f07b012c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:11.418526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcf11b-fc7d-4a4b-9ff5-621f07b012c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.418803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcf11b-fc7d-4a4b-9ff5-621f07b012c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.419075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcf11b-fc7d-4a4b-9ff5-621f07b012c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.419770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcf11b-fc7d-4a4b-9ff5-621f07b012c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:11.421636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcf11b-fc7d-4a4b-9ff5-621f07b012c5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:11.442864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dddad-95b6-4bcb-8f3d-358d5c3e3442 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:11.446124 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9accb8-b492-4c67-8511-cf9cc8063305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:11.446776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9accb8-b492-4c67-8511-cf9cc8063305 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.447052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9accb8-b492-4c67-8511-cf9cc8063305 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.447324 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9accb8-b492-4c67-8511-cf9cc8063305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.456771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9accb8-b492-4c67-8511-cf9cc8063305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:11.458505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9accb8-b492-4c67-8511-cf9cc8063305 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:11.468026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1021/2085] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:11.514027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1065/2086] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:11 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:11.515955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9accb8-b492-4c67-8511-cf9cc8063305 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:11.526725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9accb8-b492-4c67-8511-cf9cc8063305 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:11.583499 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e6e6b-b2ad-48a1-82ae-b1ca008ba72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:11.584179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e6e6b-b2ad-48a1-82ae-b1ca008ba72e admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.584459 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e6e6b-b2ad-48a1-82ae-b1ca008ba72e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.584750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e6e6b-b2ad-48a1-82ae-b1ca008ba72e admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.585447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e6e6b-b2ad-48a1-82ae-b1ca008ba72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:11.587501 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e6e6b-b2ad-48a1-82ae-b1ca008ba72e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:11.681524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1022/2087] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:11 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:11.685736 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcf11b-fc7d-4a4b-9ff5-621f07b012c5 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:11.696495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcf11b-fc7d-4a4b-9ff5-621f07b012c5 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:11.701290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38d65f-94fa-452d-a32e-ef3c31c5aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:11.701925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38d65f-94fa-452d-a32e-ef3c31c5aef2 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.702327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38d65f-94fa-452d-a32e-ef3c31c5aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.702604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38d65f-94fa-452d-a32e-ef3c31c5aef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.703326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38d65f-94fa-452d-a32e-ef3c31c5aef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:11.704908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38d65f-94fa-452d-a32e-ef3c31c5aef2 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:11.715852 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1066/2088] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:11.719759 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e6e6b-b2ad-48a1-82ae-b1ca008ba72e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:11.731082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e6e6b-b2ad-48a1-82ae-b1ca008ba72e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:11.735775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364689d-de6a-4515-9986-9dd54f2b43c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:11.736445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364689d-de6a-4515-9986-9dd54f2b43c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.736717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364689d-de6a-4515-9986-9dd54f2b43c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.736989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364689d-de6a-4515-9986-9dd54f2b43c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.738226 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364689d-de6a-4515-9986-9dd54f2b43c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:11.739811 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364689d-de6a-4515-9986-9dd54f2b43c3 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:11.749583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1023/2089] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:11.754523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38d65f-94fa-452d-a32e-ef3c31c5aef2 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:11.765584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38d65f-94fa-452d-a32e-ef3c31c5aef2 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:11.775935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176ecbb-bf8e-40ed-bec4-82cae635d0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:11.775935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176ecbb-bf8e-40ed-bec4-82cae635d0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.775935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176ecbb-bf8e-40ed-bec4-82cae635d0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.775935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176ecbb-bf8e-40ed-bec4-82cae635d0cb admin admin] PATH_INFO: `/v3/projects/8ca4f804a2b24153a9277e78255c609f/users/358970e8b4aa48f8925e5ee11079514c/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.789451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176ecbb-bf8e-40ed-bec4-82cae635d0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca4f804a2b24153a9277e78255c609f, user_id=358970e8b4aa48f8925e5ee11079514c, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:11.792151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176ecbb-bf8e-40ed-bec4-82cae635d0cb admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:11.933577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1067/2090] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:11 2022] PUT /identity/v3/projects/8ca4f804a2b24153a9277e78255c609f/users/358970e8b4aa48f8925e5ee11079514c/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:11.946054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262787a7-e27f-476b-9dee-258e0ebd0914 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:11.946555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262787a7-e27f-476b-9dee-258e0ebd0914 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:11.946653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262787a7-e27f-476b-9dee-258e0ebd0914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:11.976203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-262787a7-e27f-476b-9dee-258e0ebd0914 None None] MFA Rules not processed for user `358970e8b4aa48f8925e5ee11079514c`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:11.977423 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-262787a7-e27f-476b-9dee-258e0ebd0914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:12.015122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176ecbb-bf8e-40ed-bec4-82cae635d0cb admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.023256 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3176ecbb-bf8e-40ed-bec4-82cae635d0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:12.068207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1024/2091] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:12.072523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262787a7-e27f-476b-9dee-258e0ebd0914 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.108399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176ecbb-bf8e-40ed-bec4-82cae635d0cb admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.113884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.114815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.115094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.115365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] PATH_INFO: `/v3/projects/9b564f6c4fde4830a745ca8097ef0429` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.116560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b564f6c4fde4830a745ca8097ef0429)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.118700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.141688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262787a7-e27f-476b-9dee-258e0ebd0914 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.146764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3173a-7523-44a0-8636-4232a9099a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.147533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3173a-7523-44a0-8636-4232a9099a8f admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.147864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3173a-7523-44a0-8636-4232a9099a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.148148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3173a-7523-44a0-8636-4232a9099a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.148839 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3173a-7523-44a0-8636-4232a9099a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.150830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3173a-7523-44a0-8636-4232a9099a8f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.235404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b564f6c4fde4830a745ca8097ef0429', 'request_id': 'req-fbb6dad8-74e4-4067-a9b9-81bc175c243b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:12.242506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b564f6c4fde4830a745ca8097ef0429', 'request_id': 'req-fbb6dad8-74e4-4067-a9b9-81bc175c243b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:12.253973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1025/2092] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:12 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:12.258132 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3173a-7523-44a0-8636-4232a9099a8f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.319513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3173a-7523-44a0-8636-4232a9099a8f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.324219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11540e-7d1f-4571-9d0f-5dabae3f4962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.324914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11540e-7d1f-4571-9d0f-5dabae3f4962 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.325237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11540e-7d1f-4571-9d0f-5dabae3f4962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.325466 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11540e-7d1f-4571-9d0f-5dabae3f4962 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.326193 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11540e-7d1f-4571-9d0f-5dabae3f4962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.328141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11540e-7d1f-4571-9d0f-5dabae3f4962 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.332367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b564f6c4fde4830a745ca8097ef0429', 'request_id': 'req-fbb6dad8-74e4-4067-a9b9-81bc175c243b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:12.343658 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] The token cache is being invalidate because project 9b564f6c4fde4830a745ca8097ef0429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:12.343941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:12.344602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fbb6dad8-74e4-4067-a9b9-81bc175c243b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:12.346266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1068/2093] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:12 2022] DELETE /identity/v3/projects/9b564f6c4fde4830a745ca8097ef0429 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:12.351712 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65c27c-e20e-45df-bf04-08a503455eb8 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.351998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65c27c-e20e-45df-bf04-08a503455eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.352273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65c27c-e20e-45df-bf04-08a503455eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.372231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ea65c27c-e20e-45df-bf04-08a503455eb8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:12.373419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ea65c27c-e20e-45df-bf04-08a503455eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:12.382634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1069/2094] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:12.391010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc29465-b62f-415d-b789-6120609a93b3 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.391292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc29465-b62f-415d-b789-6120609a93b3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.391564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc29465-b62f-415d-b789-6120609a93b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.408698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-dcc29465-b62f-415d-b789-6120609a93b3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:12.410519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-dcc29465-b62f-415d-b789-6120609a93b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:12.418126 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1070/2095] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:12.421871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc29465-b62f-415d-b789-6120609a93b3 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.430938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc29465-b62f-415d-b789-6120609a93b3 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.435442 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf179e4-91ab-42da-9f0e-9bad95f2c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.436051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf179e4-91ab-42da-9f0e-9bad95f2c854 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.436329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf179e4-91ab-42da-9f0e-9bad95f2c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.436599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf179e4-91ab-42da-9f0e-9bad95f2c854 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.437294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf179e4-91ab-42da-9f0e-9bad95f2c854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:12.437590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf179e4-91ab-42da-9f0e-9bad95f2c854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.439181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf179e4-91ab-42da-9f0e-9bad95f2c854 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.447068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1026/2096] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:12 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:12.451459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1071/2097] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:57:12.451781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11540e-7d1f-4571-9d0f-5dabae3f4962 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.453380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4b11540e-7d1f-4571-9d0f-5dabae3f4962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:12.455359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf179e4-91ab-42da-9f0e-9bad95f2c854 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.465829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf179e4-91ab-42da-9f0e-9bad95f2c854 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.466185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11540e-7d1f-4571-9d0f-5dabae3f4962 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.470718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72027776-077a-4c28-903f-77b550cf1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.471101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e62c9-456d-41a9-ad6a-7f8d64151451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.471423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72027776-077a-4c28-903f-77b550cf1f81 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.472254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72027776-077a-4c28-903f-77b550cf1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.472379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e62c9-456d-41a9-ad6a-7f8d64151451 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.472671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72027776-077a-4c28-903f-77b550cf1f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.472823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e62c9-456d-41a9-ad6a-7f8d64151451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.472986 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e62c9-456d-41a9-ad6a-7f8d64151451 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.473376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72027776-077a-4c28-903f-77b550cf1f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.473730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e62c9-456d-41a9-ad6a-7f8d64151451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.475364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72027776-077a-4c28-903f-77b550cf1f81 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.475489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e62c9-456d-41a9-ad6a-7f8d64151451 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.496893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1027/2098] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:12.496893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e62c9-456d-41a9-ad6a-7f8d64151451 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.504749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e62c9-456d-41a9-ad6a-7f8d64151451 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.509441 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030506b4-d4b7-4327-8a85-9fd2e3a56038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.510347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030506b4-d4b7-4327-8a85-9fd2e3a56038 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.510628 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030506b4-d4b7-4327-8a85-9fd2e3a56038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.510908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030506b4-d4b7-4327-8a85-9fd2e3a56038 admin admin] PATH_INFO: `/v3/projects/a155b33fd6ab49898f6e9dc7082cfb6e/users/61241b8941364ad19bca53d89bcdc6b1/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.526935 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030506b4-d4b7-4327-8a85-9fd2e3a56038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a155b33fd6ab49898f6e9dc7082cfb6e, user_id=61241b8941364ad19bca53d89bcdc6b1, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.529642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030506b4-d4b7-4327-8a85-9fd2e3a56038 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.619032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1028/2099] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:12 2022] PUT /identity/v3/projects/a155b33fd6ab49898f6e9dc7082cfb6e/users/61241b8941364ad19bca53d89bcdc6b1/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:12.620081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1072/2100] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:12 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:12.623121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030506b4-d4b7-4327-8a85-9fd2e3a56038 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.624394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72027776-077a-4c28-903f-77b550cf1f81 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.690171 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72027776-077a-4c28-903f-77b550cf1f81 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.695054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030506b4-d4b7-4327-8a85-9fd2e3a56038 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.695435 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f54ca1-2cb9-4189-a376-7291e28a9edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.696118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f54ca1-2cb9-4189-a376-7291e28a9edf admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.696539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f54ca1-2cb9-4189-a376-7291e28a9edf admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.697012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f54ca1-2cb9-4189-a376-7291e28a9edf admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.697815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f54ca1-2cb9-4189-a376-7291e28a9edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.699954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe08a31-83ea-4ce3-b539-78f1e610b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.700084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f54ca1-2cb9-4189-a376-7291e28a9edf admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.700617 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08a31-83ea-4ce3-b539-78f1e610b42f admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.700898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08a31-83ea-4ce3-b539-78f1e610b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.701224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe08a31-83ea-4ce3-b539-78f1e610b42f admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.702055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe08a31-83ea-4ce3-b539-78f1e610b42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.703714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe08a31-83ea-4ce3-b539-78f1e610b42f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.715788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1029/2101] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:12.720222 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe08a31-83ea-4ce3-b539-78f1e610b42f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.731665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe08a31-83ea-4ce3-b539-78f1e610b42f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.737252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91fd4f-e189-4b42-b96c-74fda735d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.738246 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91fd4f-e189-4b42-b96c-74fda735d61c admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.738826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91fd4f-e189-4b42-b96c-74fda735d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.738826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91fd4f-e189-4b42-b96c-74fda735d61c admin admin] PATH_INFO: `/v3/projects/a155b33fd6ab49898f6e9dc7082cfb6e/users/61241b8941364ad19bca53d89bcdc6b1/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.740718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91fd4f-e189-4b42-b96c-74fda735d61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a155b33fd6ab49898f6e9dc7082cfb6e, user_id=61241b8941364ad19bca53d89bcdc6b1, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.743456 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91fd4f-e189-4b42-b96c-74fda735d61c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.755200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1030/2102] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:12 2022] PUT /identity/v3/projects/a155b33fd6ab49898f6e9dc7082cfb6e/users/61241b8941364ad19bca53d89bcdc6b1/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:12.765066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93b32-6683-4e71-8bef-da7057148646 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.765353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93b32-6683-4e71-8bef-da7057148646 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.765627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c93b32-6683-4e71-8bef-da7057148646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.795298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-06c93b32-6683-4e71-8bef-da7057148646 None None] MFA Rules not processed for user `61241b8941364ad19bca53d89bcdc6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:12.796547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-06c93b32-6683-4e71-8bef-da7057148646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:12.844801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1073/2103] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:12 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:12.850529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f54ca1-2cb9-4189-a376-7291e28a9edf admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.874141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f54ca1-2cb9-4189-a376-7291e28a9edf admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.885431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1031/2104] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:12.899166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c93b32-6683-4e71-8bef-da7057148646 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.900567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-06c93b32-6683-4e71-8bef-da7057148646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:12.917791 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f39a18-1bf7-40c4-8e03-22066580f8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.918505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f39a18-1bf7-40c4-8e03-22066580f8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.918840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f39a18-1bf7-40c4-8e03-22066580f8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.919115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f39a18-1bf7-40c4-8e03-22066580f8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.919836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f39a18-1bf7-40c4-8e03-22066580f8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.921415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f39a18-1bf7-40c4-8e03-22066580f8d1 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.931831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1074/2105] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:12.935656 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f39a18-1bf7-40c4-8e03-22066580f8d1 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.945822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f39a18-1bf7-40c4-8e03-22066580f8d1 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.950617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250b729-2af6-4d04-add1-a2fdb9322bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.951447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b729-2af6-4d04-add1-a2fdb9322bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.955826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b729-2af6-4d04-add1-a2fdb9322bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.955826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250b729-2af6-4d04-add1-a2fdb9322bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.955826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250b729-2af6-4d04-add1-a2fdb9322bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.955826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250b729-2af6-4d04-add1-a2fdb9322bb0 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.957443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c93b32-6683-4e71-8bef-da7057148646 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.961016 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e6112-ea2a-4b05-b7a5-1ae8393b2018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.961756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e6112-ea2a-4b05-b7a5-1ae8393b2018 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.961932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e6112-ea2a-4b05-b7a5-1ae8393b2018 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.962225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e6112-ea2a-4b05-b7a5-1ae8393b2018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:12.965105 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1075/2106] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:12.969149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250b729-2af6-4d04-add1-a2fdb9322bb0 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:12.972217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e6112-ea2a-4b05-b7a5-1ae8393b2018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:12.973643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e6112-ea2a-4b05-b7a5-1ae8393b2018 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:12.978790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250b729-2af6-4d04-add1-a2fdb9322bb0 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:12.983049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1032/2107] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:12.983640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc7a20-fa65-4707-896a-02a03b3fcf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:12.984604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc7a20-fa65-4707-896a-02a03b3fcf9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:12.984965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc7a20-fa65-4707-896a-02a03b3fcf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:12.985250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc7a20-fa65-4707-896a-02a03b3fcf9b admin admin] PATH_INFO: `/v3/projects/1698b291f4354856ab5ce32eaf73af90/users/ac5ec9f760dc47038190b47d582c206b/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:13.000408 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc7a20-fa65-4707-896a-02a03b3fcf9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1698b291f4354856ab5ce32eaf73af90, user_id=ac5ec9f760dc47038190b47d582c206b, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:13.003771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc7a20-fa65-4707-896a-02a03b3fcf9b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:13.110620 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1076/2108] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:12 2022] PUT /identity/v3/projects/1698b291f4354856ab5ce32eaf73af90/users/ac5ec9f760dc47038190b47d582c206b/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:13.120991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56d0e7-af0f-4a11-a9d8-30c85e003d9f None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:13.121347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56d0e7-af0f-4a11-a9d8-30c85e003d9f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:13.121748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56d0e7-af0f-4a11-a9d8-30c85e003d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:13.151677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1e56d0e7-af0f-4a11-a9d8-30c85e003d9f None None] MFA Rules not processed for user `ac5ec9f760dc47038190b47d582c206b`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:13.153076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1e56d0e7-af0f-4a11-a9d8-30c85e003d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:13.217160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1033/2109] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:13.269849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc7a20-fa65-4707-896a-02a03b3fcf9b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:13.271709 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f9bc7a20-fa65-4707-896a-02a03b3fcf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:13.326636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc7a20-fa65-4707-896a-02a03b3fcf9b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:13.330767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55575c8d-f45b-43f0-a716-c888530b17e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:13.331640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55575c8d-f45b-43f0-a716-c888530b17e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:13.332032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55575c8d-f45b-43f0-a716-c888530b17e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:13.332233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55575c8d-f45b-43f0-a716-c888530b17e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:13.342136 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55575c8d-f45b-43f0-a716-c888530b17e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:13.343554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55575c8d-f45b-43f0-a716-c888530b17e5 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:13.353554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1077/2110] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:13.368614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56d0e7-af0f-4a11-a9d8-30c85e003d9f None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:13.373822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55575c8d-f45b-43f0-a716-c888530b17e5 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:13.384111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56d0e7-af0f-4a11-a9d8-30c85e003d9f None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:13.384111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9035c2-e871-456a-a9bc-83985b281d3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:13.384111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9035c2-e871-456a-a9bc-83985b281d3c service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:13.384111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9035c2-e871-456a-a9bc-83985b281d3c service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:13.384506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9035c2-e871-456a-a9bc-83985b281d3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:13.385847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4d9035c2-e871-456a-a9bc-83985b281d3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:13.438801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55575c8d-f45b-43f0-a716-c888530b17e5 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:13.443586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9035c2-e871-456a-a9bc-83985b281d3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:13.444352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:13.445029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9035c2-e871-456a-a9bc-83985b281d3c service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:13.445229 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:13.445508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:13.445782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] PATH_INFO: `/v3/users/ac5ec9f760dc47038190b47d582c206b` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:13.447107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5ec9f760dc47038190b47d582c206b)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:13.449095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:13.453916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1034/2111] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:13.665463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5ec9f760dc47038190b47d582c206b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:13.672227 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5ec9f760dc47038190b47d582c206b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:13.766484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5ec9f760dc47038190b47d582c206b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:13.779202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5ec9f760dc47038190b47d582c206b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:13.779850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5ec9f760dc47038190b47d582c206b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:13.786209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1078/2112] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:13 2022] DELETE /identity/v3/users/ac5ec9f760dc47038190b47d582c206b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:13.790660 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03917e-b6c8-42d1-a0d5-0c962da90f86 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:13.790952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03917e-b6c8-42d1-a0d5-0c962da90f86 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:13.791231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03917e-b6c8-42d1-a0d5-0c962da90f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:13.809553 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-eb03917e-b6c8-42d1-a0d5-0c962da90f86 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:13.810932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-eb03917e-b6c8-42d1-a0d5-0c962da90f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:13.871969 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1035/2113] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:13.881851 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:13.883477 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:13.948402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1bb97-f394-4b93-9a6d-3e58fc8a8a10 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:13.952555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f702c24-7e1c-4c54-8dbb-e156d2e43c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:13.953358 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702c24-7e1c-4c54-8dbb-e156d2e43c1b service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:13.953743 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702c24-7e1c-4c54-8dbb-e156d2e43c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:13.954234 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f702c24-7e1c-4c54-8dbb-e156d2e43c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:13.964998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f702c24-7e1c-4c54-8dbb-e156d2e43c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:13.966741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f702c24-7e1c-4c54-8dbb-e156d2e43c1b service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:13.977845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1079/2114] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:14.432286 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03917e-b6c8-42d1-a0d5-0c962da90f86 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:14.433832 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-eb03917e-b6c8-42d1-a0d5-0c962da90f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:14.447247 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03917e-b6c8-42d1-a0d5-0c962da90f86 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:14.452118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:14.453012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:14.453294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:14.454111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] PATH_INFO: `/v3/projects/1698b291f4354856ab5ce32eaf73af90` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:14.454798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1698b291f4354856ab5ce32eaf73af90)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:14.457922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:14.623355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1698b291f4354856ab5ce32eaf73af90', 'request_id': 'req-20eb2d1e-96ad-47b1-a67e-3e111b46941e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:14.630090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1698b291f4354856ab5ce32eaf73af90', 'request_id': 'req-20eb2d1e-96ad-47b1-a67e-3e111b46941e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:14.635431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1698b291f4354856ab5ce32eaf73af90', 'request_id': 'req-20eb2d1e-96ad-47b1-a67e-3e111b46941e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:14.774816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] The token cache is being invalidate because project 1698b291f4354856ab5ce32eaf73af90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:14.775278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:14.776391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-20eb2d1e-96ad-47b1-a67e-3e111b46941e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:14.778199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1036/2115] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:14 2022] DELETE /identity/v3/projects/1698b291f4354856ab5ce32eaf73af90 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:14.783192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d623cf-a689-48db-b059-ca6d3ec965a2 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:14.783680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d623cf-a689-48db-b059-ca6d3ec965a2 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:14.783756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d623cf-a689-48db-b059-ca6d3ec965a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:14.805505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e6d623cf-a689-48db-b059-ca6d3ec965a2 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:14.805777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e6d623cf-a689-48db-b059-ca6d3ec965a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:14.865390 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1080/2116] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:14.873216 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a9e0-0e4a-45f6-9c10-efb6bc7d65d4 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:14.873498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a9e0-0e4a-45f6-9c10-efb6bc7d65d4 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:14.873774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81a9e0-0e4a-45f6-9c10-efb6bc7d65d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:14.892903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-2b81a9e0-0e4a-45f6-9c10-efb6bc7d65d4 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:14.894410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2b81a9e0-0e4a-45f6-9c10-efb6bc7d65d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:14.902849 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1037/2117] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:14.907265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d623cf-a689-48db-b059-ca6d3ec965a2 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:14.916793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d623cf-a689-48db-b059-ca6d3ec965a2 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:14.921438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a05eee-ff49-4fd9-8f2d-4dea3a3fee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:14.922121 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05eee-ff49-4fd9-8f2d-4dea3a3fee8a admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:14.922405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05eee-ff49-4fd9-8f2d-4dea3a3fee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:14.922677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a05eee-ff49-4fd9-8f2d-4dea3a3fee8a admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:14.923395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a05eee-ff49-4fd9-8f2d-4dea3a3fee8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:14.923698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a05eee-ff49-4fd9-8f2d-4dea3a3fee8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:14.926056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a05eee-ff49-4fd9-8f2d-4dea3a3fee8a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:14.937360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1081/2118] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:14.942447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a9e0-0e4a-45f6-9c10-efb6bc7d65d4 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:14.951355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81a9e0-0e4a-45f6-9c10-efb6bc7d65d4 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:14.956097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377ae66-b37e-41a3-a866-eddb8810dc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:14.956774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ae66-b37e-41a3-a866-eddb8810dc81 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:14.957050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ae66-b37e-41a3-a866-eddb8810dc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:14.957319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377ae66-b37e-41a3-a866-eddb8810dc81 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:14.958028 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377ae66-b37e-41a3-a866-eddb8810dc81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:14.959925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377ae66-b37e-41a3-a866-eddb8810dc81 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:15.054172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1038/2119] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:14 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:15.058316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a05eee-ff49-4fd9-8f2d-4dea3a3fee8a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:15.069332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a05eee-ff49-4fd9-8f2d-4dea3a3fee8a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:15.126820 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372a80-5a48-4017-953c-01962ee06ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:15.127553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372a80-5a48-4017-953c-01962ee06ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:15.127837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372a80-5a48-4017-953c-01962ee06ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:15.128640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372a80-5a48-4017-953c-01962ee06ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:15.129629 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b372a80-5a48-4017-953c-01962ee06ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:15.131606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b372a80-5a48-4017-953c-01962ee06ee5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:15.191523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1082/2120] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:15 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:15.195669 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377ae66-b37e-41a3-a866-eddb8810dc81 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:15.209717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377ae66-b37e-41a3-a866-eddb8810dc81 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:15.223344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771b6b-074c-4168-aac7-6e252f28d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:15.223344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771b6b-074c-4168-aac7-6e252f28d7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:15.223344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771b6b-074c-4168-aac7-6e252f28d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:15.223344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771b6b-074c-4168-aac7-6e252f28d7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:15.223792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771b6b-074c-4168-aac7-6e252f28d7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:15.224331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771b6b-074c-4168-aac7-6e252f28d7b1 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:15.237740 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1039/2121] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:15.239003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372a80-5a48-4017-953c-01962ee06ee5 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:15.248739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372a80-5a48-4017-953c-01962ee06ee5 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:15.253921 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e4c03-8107-4667-9d2c-482061b9e0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:15.254603 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4c03-8107-4667-9d2c-482061b9e0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:15.254884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4c03-8107-4667-9d2c-482061b9e0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:15.255157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e4c03-8107-4667-9d2c-482061b9e0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:15.255873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e4c03-8107-4667-9d2c-482061b9e0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:15.257446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e4c03-8107-4667-9d2c-482061b9e0e2 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:15.267004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1083/2122] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:15.271755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771b6b-074c-4168-aac7-6e252f28d7b1 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:15.281540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771b6b-074c-4168-aac7-6e252f28d7b1 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:15.286185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760458d-c6a0-4f75-81ab-81f0084cd6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:15.287049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760458d-c6a0-4f75-81ab-81f0084cd6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:15.287330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760458d-c6a0-4f75-81ab-81f0084cd6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:15.287606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760458d-c6a0-4f75-81ab-81f0084cd6ce admin admin] PATH_INFO: `/v3/projects/4a8daa49cc29446d87aac8e1b6b5b13b/users/afbb4acb0acb4791ae465463176bcdbd/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:15.301470 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760458d-c6a0-4f75-81ab-81f0084cd6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8daa49cc29446d87aac8e1b6b5b13b, user_id=afbb4acb0acb4791ae465463176bcdbd, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:15.304193 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760458d-c6a0-4f75-81ab-81f0084cd6ce admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:15.377540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1040/2123] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:15 2022] PUT /identity/v3/projects/4a8daa49cc29446d87aac8e1b6b5b13b/users/afbb4acb0acb4791ae465463176bcdbd/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:15.389366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a6787-8d6d-4679-8ace-e7355c4e09ff None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:15.389650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a6787-8d6d-4679-8ace-e7355c4e09ff None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:15.389953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a6787-8d6d-4679-8ace-e7355c4e09ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:15.417523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-249a6787-8d6d-4679-8ace-e7355c4e09ff None None] MFA Rules not processed for user `afbb4acb0acb4791ae465463176bcdbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:15.418779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-249a6787-8d6d-4679-8ace-e7355c4e09ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:15.479230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1084/2124] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:15.490678 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760458d-c6a0-4f75-81ab-81f0084cd6ce admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:15.492431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7760458d-c6a0-4f75-81ab-81f0084cd6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:15.546771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760458d-c6a0-4f75-81ab-81f0084cd6ce admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:15.550906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d425937-fe7b-4027-8c9c-25f6ae544d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:15.551538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d425937-fe7b-4027-8c9c-25f6ae544d37 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:15.551812 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d425937-fe7b-4027-8c9c-25f6ae544d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:15.552085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d425937-fe7b-4027-8c9c-25f6ae544d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:15.560108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d425937-fe7b-4027-8c9c-25f6ae544d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:15.561570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d425937-fe7b-4027-8c9c-25f6ae544d37 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:15.570885 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1041/2125] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:21.194034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a6787-8d6d-4679-8ace-e7355c4e09ff None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:21.204096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a6787-8d6d-4679-8ace-e7355c4e09ff None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:21.208739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077d15d-5099-41e2-91e3-90e5c556077c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:21.209399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077d15d-5099-41e2-91e3-90e5c556077c service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:21.212705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077d15d-5099-41e2-91e3-90e5c556077c service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:21.212705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077d15d-5099-41e2-91e3-90e5c556077c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:21.212705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a077d15d-5099-41e2-91e3-90e5c556077c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:21.278902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077d15d-5099-41e2-91e3-90e5c556077c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:21.280411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077d15d-5099-41e2-91e3-90e5c556077c service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:21.290292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1085/2126] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:28.197076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d425937-fe7b-4027-8c9c-25f6ae544d37 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:28.198594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9d425937-fe7b-4027-8c9c-25f6ae544d37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:28.265648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d425937-fe7b-4027-8c9c-25f6ae544d37 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:28.273982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:28.274883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:28.275162 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:28.275429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] PATH_INFO: `/v3/users/358970e8b4aa48f8925e5ee11079514c` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:28.276644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358970e8b4aa48f8925e5ee11079514c)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:28.280340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:28.311993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077d15d-5099-41e2-91e3-90e5c556077c service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:28.314384 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a077d15d-5099-41e2-91e3-90e5c556077c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:28.337484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077d15d-5099-41e2-91e3-90e5c556077c service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:28.340527 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:28.341450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:28.341936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:28.342286 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] PATH_INFO: `/v3/users/8c66af0cfab14a74b9290db14f41608e` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:28.343554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c66af0cfab14a74b9290db14f41608e)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:28.345522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:28.526272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358970e8b4aa48f8925e5ee11079514c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:28.526948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358970e8b4aa48f8925e5ee11079514c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:28.559027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c66af0cfab14a74b9290db14f41608e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:28.568072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c66af0cfab14a74b9290db14f41608e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:28.640864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358970e8b4aa48f8925e5ee11079514c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:28.648560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358970e8b4aa48f8925e5ee11079514c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:28.660573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-80211e40-8eca-4ed4-802d-eb0ea6c2bfa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358970e8b4aa48f8925e5ee11079514c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:28.666489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1042/2127] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:28 2022] DELETE /identity/v3/users/358970e8b4aa48f8925e5ee11079514c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:28.670824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aea69e-d3a0-466d-b9d4-98c2a391cfc6 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:28.673396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aea69e-d3a0-466d-b9d4-98c2a391cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:28.673396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aea69e-d3a0-466d-b9d4-98c2a391cfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:28.688324 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-72aea69e-d3a0-466d-b9d4-98c2a391cfc6 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:28.689527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-72aea69e-d3a0-466d-b9d4-98c2a391cfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:28.721065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c66af0cfab14a74b9290db14f41608e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:28.744897 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c66af0cfab14a74b9290db14f41608e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:28.744897 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c66af0cfab14a74b9290db14f41608e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:28.748691 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1086/2128] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:28 2022] DELETE /identity/v3/users/8c66af0cfab14a74b9290db14f41608e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:28.750882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1043/2129] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:28.763352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:28.764769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:28.829281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e32aa9-2c57-4249-bf0a-57c1afd76c7f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:28.833101 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67e3db-80c5-4e1a-ad03-ce0a163a69ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:28.836150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67e3db-80c5-4e1a-ad03-ce0a163a69ab service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:28.836150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67e3db-80c5-4e1a-ad03-ce0a163a69ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:28.836150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67e3db-80c5-4e1a-ad03-ce0a163a69ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:28.896853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67e3db-80c5-4e1a-ad03-ce0a163a69ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:28.898241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67e3db-80c5-4e1a-ad03-ce0a163a69ab service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:28.910855 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1087/2130] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:28.934492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aea69e-d3a0-466d-b9d4-98c2a391cfc6 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:28.935979 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-72aea69e-d3a0-466d-b9d4-98c2a391cfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:28.948510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aea69e-d3a0-466d-b9d4-98c2a391cfc6 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:28.953382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:28.954467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:28.955464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:28.957796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] PATH_INFO: `/v3/users/2c586371cf474cbda107b6babed757b9` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:28.957796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c586371cf474cbda107b6babed757b9)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:28.959353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:29.019809 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67e3db-80c5-4e1a-ad03-ce0a163a69ab service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:29.021235 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-af67e3db-80c5-4e1a-ad03-ce0a163a69ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:29.033796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67e3db-80c5-4e1a-ad03-ce0a163a69ab service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:29.039331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:29.040178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:29.040456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:29.040735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] PATH_INFO: `/v3/projects/6d20770e075f46b48eb2fc1a898613e7` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:29.041920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d20770e075f46b48eb2fc1a898613e7)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:29.043849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:29.309763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d20770e075f46b48eb2fc1a898613e7', 'request_id': 'req-710792fe-434e-4b55-9721-ccffb98c1c61'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.316659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d20770e075f46b48eb2fc1a898613e7', 'request_id': 'req-710792fe-434e-4b55-9721-ccffb98c1c61'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.441469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d20770e075f46b48eb2fc1a898613e7', 'request_id': 'req-710792fe-434e-4b55-9721-ccffb98c1c61'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.452765 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] The token cache is being invalidate because project 6d20770e075f46b48eb2fc1a898613e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:29.453051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.453694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.455043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c586371cf474cbda107b6babed757b9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.455543 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1088/2131] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:29 2022] DELETE /identity/v3/projects/6d20770e075f46b48eb2fc1a898613e7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:29.456068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c586371cf474cbda107b6babed757b9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.456284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:29.457626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:29.519928 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710792fe-434e-4b55-9721-ccffb98c1c61 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:29.524507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:29.531790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:29.531790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:29.531790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] PATH_INFO: `/v3/projects/8ca4f804a2b24153a9277e78255c609f` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:29.531790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca4f804a2b24153a9277e78255c609f)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:29.531790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:29.584525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c586371cf474cbda107b6babed757b9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.592617 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c586371cf474cbda107b6babed757b9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.607027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b37daa3e-2647-4611-a81d-0a3d52c65ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c586371cf474cbda107b6babed757b9'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.615607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1044/2132] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:28 2022] DELETE /identity/v3/users/2c586371cf474cbda107b6babed757b9 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:29.617124 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffa49d-8eac-40e9-81de-3e5be5a0615c None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:29.617484 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffa49d-8eac-40e9-81de-3e5be5a0615c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:29.617937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffa49d-8eac-40e9-81de-3e5be5a0615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:29.640126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-70ffa49d-8eac-40e9-81de-3e5be5a0615c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:29.641434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-70ffa49d-8eac-40e9-81de-3e5be5a0615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:29.676512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca4f804a2b24153a9277e78255c609f', 'request_id': 'req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.686801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca4f804a2b24153a9277e78255c609f', 'request_id': 'req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.711686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1045/2133] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:29.713228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e461-b010-4f95-9a85-f9560f279538 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:29.713512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e461-b010-4f95-9a85-f9560f279538 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:29.713784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e461-b010-4f95-9a85-f9560f279538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:29.731813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-7852e461-b010-4f95-9a85-f9560f279538 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:29.733035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7852e461-b010-4f95-9a85-f9560f279538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:29.777732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca4f804a2b24153a9277e78255c609f', 'request_id': 'req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.789694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] The token cache is being invalidate because project 8ca4f804a2b24153a9277e78255c609f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:29.790011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.790686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-58cf31a4-48d9-42d4-b1de-f9d6a2a0b51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:29.792250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1089/2134] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:29 2022] DELETE /identity/v3/projects/8ca4f804a2b24153a9277e78255c609f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:29.792695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1046/2135] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:29.796263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852e461-b010-4f95-9a85-f9560f279538 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:29.796493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b04476-df39-42e8-9253-31e4bc0dc1fd None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:29.796781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b04476-df39-42e8-9253-31e4bc0dc1fd None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:29.797056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b04476-df39-42e8-9253-31e4bc0dc1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:29.797843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7852e461-b010-4f95-9a85-f9560f279538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:29.810178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852e461-b010-4f95-9a85-f9560f279538 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:29.815876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:29.816781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-76b04476-df39-42e8-9253-31e4bc0dc1fd None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:29.816999 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:29.817278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:29.817551 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] PATH_INFO: `/v3/users/61241b8941364ad19bca53d89bcdc6b1` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:29.818245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-76b04476-df39-42e8-9253-31e4bc0dc1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:29.818856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] RBAC: Authorizing `identity:delete_user(user_id=61241b8941364ad19bca53d89bcdc6b1)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:29.820929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:29.826233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1090/2136] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:29.827202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b04476-df39-42e8-9253-31e4bc0dc1fd None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:29.828489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-76b04476-df39-42e8-9253-31e4bc0dc1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:29.887420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b04476-df39-42e8-9253-31e4bc0dc1fd None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:29.891082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b745f1-068b-4ea8-b7d9-6c98e1260e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:29.891710 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b745f1-068b-4ea8-b7d9-6c98e1260e3e service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:29.891996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b745f1-068b-4ea8-b7d9-6c98e1260e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:29.892270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b745f1-068b-4ea8-b7d9-6c98e1260e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:29.894117 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-86b745f1-068b-4ea8-b7d9-6c98e1260e3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:29.905768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b745f1-068b-4ea8-b7d9-6c98e1260e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:29.907244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b745f1-068b-4ea8-b7d9-6c98e1260e3e service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:29.916538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1091/2137] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:29.917310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b745f1-068b-4ea8-b7d9-6c98e1260e3e service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:29.926505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b745f1-068b-4ea8-b7d9-6c98e1260e3e service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:29.931404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdd747-d78d-4cc2-b9b2-f83223a9f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:29.932048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd747-d78d-4cc2-b9b2-f83223a9f833 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:29.932333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd747-d78d-4cc2-b9b2-f83223a9f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:29.932610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd747-d78d-4cc2-b9b2-f83223a9f833 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:29.933321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdd747-d78d-4cc2-b9b2-f83223a9f833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:29.933624 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdd747-d78d-4cc2-b9b2-f83223a9f833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:29.935423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdd747-d78d-4cc2-b9b2-f83223a9f833 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:29.948760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1092/2138] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:29.952973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdd747-d78d-4cc2-b9b2-f83223a9f833 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:29.964689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdd747-d78d-4cc2-b9b2-f83223a9f833 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:29.969918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bffed-fc66-4498-80b3-8dfa347f7dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:29.970421 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bffed-fc66-4498-80b3-8dfa347f7dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:29.970716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bffed-fc66-4498-80b3-8dfa347f7dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:29.970991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bffed-fc66-4498-80b3-8dfa347f7dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:29.972027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bffed-fc66-4498-80b3-8dfa347f7dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:29.974154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bffed-fc66-4498-80b3-8dfa347f7dd5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:30.042831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61241b8941364ad19bca53d89bcdc6b1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:30.043479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61241b8941364ad19bca53d89bcdc6b1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:30.065880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1093/2139] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:29 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:30.069967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bffed-fc66-4498-80b3-8dfa347f7dd5 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:30.131643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bffed-fc66-4498-80b3-8dfa347f7dd5 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:30.136684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2668-b923-4c68-9ba8-07b82ce1e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:30.137371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2668-b923-4c68-9ba8-07b82ce1e72b admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:30.137650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2668-b923-4c68-9ba8-07b82ce1e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:30.137922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2668-b923-4c68-9ba8-07b82ce1e72b admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:30.138642 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc2668-b923-4c68-9ba8-07b82ce1e72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:30.140580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc2668-b923-4c68-9ba8-07b82ce1e72b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:30.144564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61241b8941364ad19bca53d89bcdc6b1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:30.153574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61241b8941364ad19bca53d89bcdc6b1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:30.167160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61241b8941364ad19bca53d89bcdc6b1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:30.174108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1047/2140] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:29 2022] DELETE /identity/v3/users/61241b8941364ad19bca53d89bcdc6b1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:30.246433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1094/2141] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:30 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:30.247337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:30.248874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:30.320392 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80be3-5658-4dec-bfdd-105ff28c877a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:30.325492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9248d-4c64-4f0d-8369-6941d764c2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:30.326197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9248d-4c64-4f0d-8369-6941d764c2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:30.326477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9248d-4c64-4f0d-8369-6941d764c2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:30.326764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9248d-4c64-4f0d-8369-6941d764c2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:30.327490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9248d-4c64-4f0d-8369-6941d764c2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:30.329451 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9248d-4c64-4f0d-8369-6941d764c2e6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:30.340816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1048/2142] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:30.345011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2668-b923-4c68-9ba8-07b82ce1e72b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:30.356457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2668-b923-4c68-9ba8-07b82ce1e72b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:30.361118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144bb2e-1e09-4159-8a00-ef4f32c51e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:30.361778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144bb2e-1e09-4159-8a00-ef4f32c51e55 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:30.362812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144bb2e-1e09-4159-8a00-ef4f32c51e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:30.363609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144bb2e-1e09-4159-8a00-ef4f32c51e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:30.364381 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144bb2e-1e09-4159-8a00-ef4f32c51e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:30.366015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144bb2e-1e09-4159-8a00-ef4f32c51e55 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:30.375914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1095/2143] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:30.380110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9248d-4c64-4f0d-8369-6941d764c2e6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:30.389680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9248d-4c64-4f0d-8369-6941d764c2e6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:30.394493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c61995-4126-48c6-a211-f9c7ceb40c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:30.395357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c61995-4126-48c6-a211-f9c7ceb40c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:30.395634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c61995-4126-48c6-a211-f9c7ceb40c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:30.395904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c61995-4126-48c6-a211-f9c7ceb40c46 admin admin] PATH_INFO: `/v3/projects/2f1cb61601cc40c6bbcec42caf3f4f09/users/971e137352bb493eb4dea22d1c068366/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:30.410289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c61995-4126-48c6-a211-f9c7ceb40c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1cb61601cc40c6bbcec42caf3f4f09, user_id=971e137352bb493eb4dea22d1c068366, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:30.412926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c61995-4126-48c6-a211-f9c7ceb40c46 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:30.506280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144bb2e-1e09-4159-8a00-ef4f32c51e55 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:30.508346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-6144bb2e-1e09-4159-8a00-ef4f32c51e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:30.524724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144bb2e-1e09-4159-8a00-ef4f32c51e55 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:30.531610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:30.532486 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:30.532763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:30.533045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] PATH_INFO: `/v3/projects/1dea36fb51ea4159a0cb518c026e8859` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:30.534581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dea36fb51ea4159a0cb518c026e8859)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:30.536562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:30.601210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1049/2144] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:30 2022] PUT /identity/v3/projects/2f1cb61601cc40c6bbcec42caf3f4f09/users/971e137352bb493eb4dea22d1c068366/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:30.611360 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0861fc8-6ac5-4865-b7da-f3f8646fb6c3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:30.612986 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0861fc8-6ac5-4865-b7da-f3f8646fb6c3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:30.613341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0861fc8-6ac5-4865-b7da-f3f8646fb6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:30.639878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a0861fc8-6ac5-4865-b7da-f3f8646fb6c3 None None] MFA Rules not processed for user `971e137352bb493eb4dea22d1c068366`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:30.641093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a0861fc8-6ac5-4865-b7da-f3f8646fb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:30.712092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1050/2145] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:30.716780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0861fc8-6ac5-4865-b7da-f3f8646fb6c3 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:30.722343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dea36fb51ea4159a0cb518c026e8859', 'request_id': 'req-2a17a45c-69cc-44a1-8e4f-08603708a78c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:30.730772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dea36fb51ea4159a0cb518c026e8859', 'request_id': 'req-2a17a45c-69cc-44a1-8e4f-08603708a78c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:30.780871 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0861fc8-6ac5-4865-b7da-f3f8646fb6c3 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:30.829377 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dea36fb51ea4159a0cb518c026e8859', 'request_id': 'req-2a17a45c-69cc-44a1-8e4f-08603708a78c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:30.841852 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] The token cache is being invalidate because project 1dea36fb51ea4159a0cb518c026e8859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:30.842181 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:30.842862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:30.845003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1096/2146] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:30 2022] DELETE /identity/v3/projects/1dea36fb51ea4159a0cb518c026e8859 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:30.846059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:30.848781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:30.850753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdb8d0-a0c9-4819-a5c2-4309bc2d2cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:30.851592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb8d0-a0c9-4819-a5c2-4309bc2d2cee admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:30.852080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb8d0-a0c9-4819-a5c2-4309bc2d2cee admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:30.852353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdb8d0-a0c9-4819-a5c2-4309bc2d2cee admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:30.853050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdb8d0-a0c9-4819-a5c2-4309bc2d2cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:30.855074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdb8d0-a0c9-4819-a5c2-4309bc2d2cee admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:30.873192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17a45c-69cc-44a1-8e4f-08603708a78c admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:30.878225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:30.879076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:30.879353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:30.879678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] PATH_INFO: `/v3/projects/a155b33fd6ab49898f6e9dc7082cfb6e` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:30.880857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a155b33fd6ab49898f6e9dc7082cfb6e)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:30.882786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:30.980922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1051/2147] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:30 2022] POST /identity/v3/projects => generated 379 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:30.981945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdb8d0-a0c9-4819-a5c2-4309bc2d2cee admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:30.983529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-53cdb8d0-a0c9-4819-a5c2-4309bc2d2cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:31.031816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a155b33fd6ab49898f6e9dc7082cfb6e', 'request_id': 'req-7424e12e-31c9-499e-adb4-5f822e3e2e8a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.038977 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a155b33fd6ab49898f6e9dc7082cfb6e', 'request_id': 'req-7424e12e-31c9-499e-adb4-5f822e3e2e8a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.047869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdb8d0-a0c9-4819-a5c2-4309bc2d2cee admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:31.105564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:31.106468 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.106750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.107024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] PATH_INFO: `/v3/users/1e51d59ed5a2437da77e64781d6f504f` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.108232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e51d59ed5a2437da77e64781d6f504f)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:31.110210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:31.154930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a155b33fd6ab49898f6e9dc7082cfb6e', 'request_id': 'req-7424e12e-31c9-499e-adb4-5f822e3e2e8a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.166511 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] The token cache is being invalidate because project a155b33fd6ab49898f6e9dc7082cfb6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:31.166791 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.167419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.168964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1097/2148] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:30 2022] DELETE /identity/v3/projects/a155b33fd6ab49898f6e9dc7082cfb6e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:31.169735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:31.171190 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:31.184724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424e12e-31c9-499e-adb4-5f822e3e2e8a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:31.189347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:31.190230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.190507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.190777 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] PATH_INFO: `/v3/users/afbb4acb0acb4791ae465463176bcdbd` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.195516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afbb4acb0acb4791ae465463176bcdbd)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:31.195516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:31.362431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e51d59ed5a2437da77e64781d6f504f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.363131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e51d59ed5a2437da77e64781d6f504f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.385310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afbb4acb0acb4791ae465463176bcdbd'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.391982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afbb4acb0acb4791ae465463176bcdbd'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.417969 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e51d59ed5a2437da77e64781d6f504f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.425137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e51d59ed5a2437da77e64781d6f504f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.436555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e51d59ed5a2437da77e64781d6f504f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.442751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1052/2149] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:30 2022] DELETE /identity/v3/users/1e51d59ed5a2437da77e64781d6f504f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:31.443505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:31.444821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:31.492915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afbb4acb0acb4791ae465463176bcdbd'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.506962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afbb4acb0acb4791ae465463176bcdbd'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.508345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-32a56d43-77bd-4a36-ae75-4f1066219fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afbb4acb0acb4791ae465463176bcdbd'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:31.514692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1098/2150] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:31 2022] DELETE /identity/v3/users/afbb4acb0acb4791ae465463176bcdbd => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:31.518034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced0fc-1062-4174-ab72-4ba9e642c5de None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.518034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced0fc-1062-4174-ab72-4ba9e642c5de None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.518034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ced0fc-1062-4174-ab72-4ba9e642c5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.519077 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a905b-0b5b-497b-b108-3227d18d9905 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:31.535600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-07ced0fc-1062-4174-ab72-4ba9e642c5de None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:31.536817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-07ced0fc-1062-4174-ab72-4ba9e642c5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:31.579671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571c5b3-d3a2-434e-af36-2a356c08d36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:31.580350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c5b3-d3a2-434e-af36-2a356c08d36f admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.580690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c5b3-d3a2-434e-af36-2a356c08d36f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.581538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c5b3-d3a2-434e-af36-2a356c08d36f admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.582371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571c5b3-d3a2-434e-af36-2a356c08d36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:31.584319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571c5b3-d3a2-434e-af36-2a356c08d36f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:31.596259 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1099/2151] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:31.597613 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941033e1-dea4-40c3-afc7-9d045ada731b None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.597903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941033e1-dea4-40c3-afc7-9d045ada731b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.598199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941033e1-dea4-40c3-afc7-9d045ada731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.616750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-941033e1-dea4-40c3-afc7-9d045ada731b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:31.617839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-941033e1-dea4-40c3-afc7-9d045ada731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:31.625761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1100/2152] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:31.628947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86a1ba-bad7-4df4-9d4b-acc36fe007bb None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.628947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86a1ba-bad7-4df4-9d4b-acc36fe007bb None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.628947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86a1ba-bad7-4df4-9d4b-acc36fe007bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.657958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-5c86a1ba-bad7-4df4-9d4b-acc36fe007bb None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:31.657958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5c86a1ba-bad7-4df4-9d4b-acc36fe007bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:31.665090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1101/2153] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:31.666210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86a1ba-bad7-4df4-9d4b-acc36fe007bb None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:31.667457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5c86a1ba-bad7-4df4-9d4b-acc36fe007bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:31.693434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1053/2154] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:31 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:31.694533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571c5b3-d3a2-434e-af36-2a356c08d36f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:31.707180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571c5b3-d3a2-434e-af36-2a356c08d36f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:31.712105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0b67c-2f44-40ee-9e7f-688075471702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:31.713720 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b67c-2f44-40ee-9e7f-688075471702 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.714035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b67c-2f44-40ee-9e7f-688075471702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.714315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b67c-2f44-40ee-9e7f-688075471702 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.715073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0b67c-2f44-40ee-9e7f-688075471702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:31.715372 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0b67c-2f44-40ee-9e7f-688075471702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:31.717019 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0b67c-2f44-40ee-9e7f-688075471702 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:31.729034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86a1ba-bad7-4df4-9d4b-acc36fe007bb None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:31.733601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1054/2155] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:31.733601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0b67c-2f44-40ee-9e7f-688075471702 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:31.733601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0fe0b67c-2f44-40ee-9e7f-688075471702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:31.739916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ea2de-9d8a-4cca-8182-2274960f7967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:31.740628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ea2de-9d8a-4cca-8182-2274960f7967 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.740912 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ea2de-9d8a-4cca-8182-2274960f7967 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.741186 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ea2de-9d8a-4cca-8182-2274960f7967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.745644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0b67c-2f44-40ee-9e7f-688075471702 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:31.750323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919d8a-8045-44c6-9188-da9417e25b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:31.750971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919d8a-8045-44c6-9188-da9417e25b46 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.751248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919d8a-8045-44c6-9188-da9417e25b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.751411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ea2de-9d8a-4cca-8182-2274960f7967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:31.751529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919d8a-8045-44c6-9188-da9417e25b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.752223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d919d8a-8045-44c6-9188-da9417e25b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:31.753758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ea2de-9d8a-4cca-8182-2274960f7967 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:31.754475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d919d8a-8045-44c6-9188-da9417e25b46 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:31.763987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1102/2156] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:31.764904 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ea2de-9d8a-4cca-8182-2274960f7967 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:31.766989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1055/2157] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:31.773787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919d8a-8045-44c6-9188-da9417e25b46 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:31.776451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ea2de-9d8a-4cca-8182-2274960f7967 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:31.781476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa2a1-c103-47c5-9892-fb1ab5a25d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:31.782222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa2a1-c103-47c5-9892-fb1ab5a25d22 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.782934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa2a1-c103-47c5-9892-fb1ab5a25d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.782934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa2a1-c103-47c5-9892-fb1ab5a25d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.783478 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fa2a1-c103-47c5-9892-fb1ab5a25d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:31.786268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fa2a1-c103-47c5-9892-fb1ab5a25d22 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:31.788188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919d8a-8045-44c6-9188-da9417e25b46 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:31.793590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226ab83-4cf1-46dd-bcc3-1a9b479f3bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:31.794673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226ab83-4cf1-46dd-bcc3-1a9b479f3bda admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:31.795096 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226ab83-4cf1-46dd-bcc3-1a9b479f3bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:31.795368 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226ab83-4cf1-46dd-bcc3-1a9b479f3bda admin admin] PATH_INFO: `/v3/projects/f9e527fca86d4e8fa2d9c1212ae7339a/users/881f8f51c9c440d4a8fbe6de2493689b/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:31.810369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226ab83-4cf1-46dd-bcc3-1a9b479f3bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e527fca86d4e8fa2d9c1212ae7339a, user_id=881f8f51c9c440d4a8fbe6de2493689b, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:31.813053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226ab83-4cf1-46dd-bcc3-1a9b479f3bda admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:31.905854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1103/2158] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:31 2022] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:31.910397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa2a1-c103-47c5-9892-fb1ab5a25d22 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:31.912221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e88fa2a1-c103-47c5-9892-fb1ab5a25d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:31.969430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1056/2159] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:31 2022] PUT /identity/v3/projects/f9e527fca86d4e8fa2d9c1212ae7339a/users/881f8f51c9c440d4a8fbe6de2493689b/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:31.969430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226ab83-4cf1-46dd-bcc3-1a9b479f3bda admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.010184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa2a1-c103-47c5-9892-fb1ab5a25d22 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.042776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226ab83-4cf1-46dd-bcc3-1a9b479f3bda admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.050485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a57ee-8826-4176-93cd-e46515cefdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:32.050485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a57ee-8826-4176-93cd-e46515cefdbe admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.050485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a57ee-8826-4176-93cd-e46515cefdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.050485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a57ee-8826-4176-93cd-e46515cefdbe admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.051026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a57ee-8826-4176-93cd-e46515cefdbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:32.053461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a57ee-8826-4176-93cd-e46515cefdbe admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:32.072035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:32.073179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.073295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.073635 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] PATH_INFO: `/v3/projects/0b3ca7806e84497f8cf3891784d21823` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.074863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3ca7806e84497f8cf3891784d21823)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:32.076819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:32.158773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1057/2160] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:31 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:32.158773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a57ee-8826-4176-93cd-e46515cefdbe admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.169221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a57ee-8826-4176-93cd-e46515cefdbe admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.173952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dfd37-adae-4cfc-b0ba-312f2d95ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:32.174680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dfd37-adae-4cfc-b0ba-312f2d95ede4 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.175030 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dfd37-adae-4cfc-b0ba-312f2d95ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.175298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dfd37-adae-4cfc-b0ba-312f2d95ede4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.176027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dfd37-adae-4cfc-b0ba-312f2d95ede4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:32.177684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dfd37-adae-4cfc-b0ba-312f2d95ede4 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:32.188806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1058/2161] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:32.189910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dfd37-adae-4cfc-b0ba-312f2d95ede4 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.193169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9a1dfd37-adae-4cfc-b0ba-312f2d95ede4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.199002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3ca7806e84497f8cf3891784d21823', 'request_id': 'req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.205405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3ca7806e84497f8cf3891784d21823', 'request_id': 'req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.206427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dfd37-adae-4cfc-b0ba-312f2d95ede4 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.261463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:32.262352 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.262639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.262911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] PATH_INFO: `/v3/users/0541074243c74c848d92f59f9f7ffcae` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.263778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3ca7806e84497f8cf3891784d21823', 'request_id': 'req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.264093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0541074243c74c848d92f59f9f7ffcae)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:32.266027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:32.275296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] The token cache is being invalidate because project 0b3ca7806e84497f8cf3891784d21823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:32.275581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.276285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.277846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1104/2162] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:31 2022] DELETE /identity/v3/projects/0b3ca7806e84497f8cf3891784d21823 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:32.281893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.283241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.300238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd51a30-0fc7-4e52-94d3-c5a560cc14e1 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.307638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6136f4-b386-43d1-ad9b-ee473a553116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:32.307638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6136f4-b386-43d1-ad9b-ee473a553116 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.307638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6136f4-b386-43d1-ad9b-ee473a553116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.307638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6136f4-b386-43d1-ad9b-ee473a553116 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.308062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6136f4-b386-43d1-ad9b-ee473a553116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:32.309793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6136f4-b386-43d1-ad9b-ee473a553116 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:32.324485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1105/2163] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:32.324485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6136f4-b386-43d1-ad9b-ee473a553116 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.324485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-6d6136f4-b386-43d1-ad9b-ee473a553116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.337597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6136f4-b386-43d1-ad9b-ee473a553116 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.342555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3488c-66e0-4abf-8921-d97fefb2c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:32.343415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3488c-66e0-4abf-8921-d97fefb2c329 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.349600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3488c-66e0-4abf-8921-d97fefb2c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.349600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3488c-66e0-4abf-8921-d97fefb2c329 admin admin] PATH_INFO: `/v3/projects/f9e527fca86d4e8fa2d9c1212ae7339a/users/881f8f51c9c440d4a8fbe6de2493689b/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.349600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3488c-66e0-4abf-8921-d97fefb2c329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e527fca86d4e8fa2d9c1212ae7339a, user_id=881f8f51c9c440d4a8fbe6de2493689b, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:32.349600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3488c-66e0-4abf-8921-d97fefb2c329 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:32.359328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1106/2164] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:32 2022] PUT /identity/v3/projects/f9e527fca86d4e8fa2d9c1212ae7339a/users/881f8f51c9c440d4a8fbe6de2493689b/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:32.360460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8d26-6e67-40f8-8549-684ce1faae85 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.360746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8d26-6e67-40f8-8549-684ce1faae85 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.361021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8d26-6e67-40f8-8549-684ce1faae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.380215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-acfb8d26-6e67-40f8-8549-684ce1faae85 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:32.381389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-acfb8d26-6e67-40f8-8549-684ce1faae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.439137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1107/2165] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:32.439894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb8d26-6e67-40f8-8549-684ce1faae85 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.441731 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-acfb8d26-6e67-40f8-8549-684ce1faae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.453332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb8d26-6e67-40f8-8549-684ce1faae85 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.458899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:32.459739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.460022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.460296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] PATH_INFO: `/v3/projects/4a8daa49cc29446d87aac8e1b6b5b13b` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.461485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8daa49cc29446d87aac8e1b6b5b13b)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:32.463690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:32.517653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0541074243c74c848d92f59f9f7ffcae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.518976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0541074243c74c848d92f59f9f7ffcae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.634145 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8daa49cc29446d87aac8e1b6b5b13b', 'request_id': 'req-7709be85-847d-485c-9475-e8a4386917e8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.640115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8daa49cc29446d87aac8e1b6b5b13b', 'request_id': 'req-7709be85-847d-485c-9475-e8a4386917e8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.669329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0541074243c74c848d92f59f9f7ffcae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.677477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0541074243c74c848d92f59f9f7ffcae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.688903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0541074243c74c848d92f59f9f7ffcae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.694981 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1059/2166] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:32 2022] DELETE /identity/v3/users/0541074243c74c848d92f59f9f7ffcae => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:32.695765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.697202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.759528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c18cd-0a1d-4a2a-ae8d-7b99a92f469f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.764191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabe0f1-f53a-4777-a6a0-78258d17b140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:32.764853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabe0f1-f53a-4777-a6a0-78258d17b140 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.765138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabe0f1-f53a-4777-a6a0-78258d17b140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.765417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabe0f1-f53a-4777-a6a0-78258d17b140 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.766176 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabe0f1-f53a-4777-a6a0-78258d17b140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:32.767782 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabe0f1-f53a-4777-a6a0-78258d17b140 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:32.777881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1060/2167] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:32.779100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db150326-a164-4c7c-868e-810f174a2ad6 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.779389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db150326-a164-4c7c-868e-810f174a2ad6 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.779665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db150326-a164-4c7c-868e-810f174a2ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.789141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8daa49cc29446d87aac8e1b6b5b13b', 'request_id': 'req-7709be85-847d-485c-9475-e8a4386917e8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.801490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] The token cache is being invalidate because project 4a8daa49cc29446d87aac8e1b6b5b13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:32.801776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.802457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7709be85-847d-485c-9475-e8a4386917e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:32.804109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1108/2168] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:32 2022] DELETE /identity/v3/projects/4a8daa49cc29446d87aac8e1b6b5b13b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:32.805274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f219e3-44ac-4b60-9a6e-9cb18628aa56 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.805556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f219e3-44ac-4b60-9a6e-9cb18628aa56 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.805828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f219e3-44ac-4b60-9a6e-9cb18628aa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.806080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-db150326-a164-4c7c-868e-810f174a2ad6 None None] MFA Rules not processed for user `881f8f51c9c440d4a8fbe6de2493689b`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:32.811442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-db150326-a164-4c7c-868e-810f174a2ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.827791 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-24f219e3-44ac-4b60-9a6e-9cb18628aa56 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:32.828980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-24f219e3-44ac-4b60-9a6e-9cb18628aa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.837482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1109/2169] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:32.839023 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601e0eb-e96c-4c97-92ba-12d5f9dbdfe2 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.839308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601e0eb-e96c-4c97-92ba-12d5f9dbdfe2 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.839582 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601e0eb-e96c-4c97-92ba-12d5f9dbdfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.857012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2601e0eb-e96c-4c97-92ba-12d5f9dbdfe2 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:32.858264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2601e0eb-e96c-4c97-92ba-12d5f9dbdfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.867105 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1110/2170] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:32.868504 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601e0eb-e96c-4c97-92ba-12d5f9dbdfe2 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.869170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2601e0eb-e96c-4c97-92ba-12d5f9dbdfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.879322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1061/2171] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:32.879322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dc7d-3b8a-49d8-bfbe-02821bb16e25 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.879322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dc7d-3b8a-49d8-bfbe-02821bb16e25 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.879322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3dc7d-3b8a-49d8-bfbe-02821bb16e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.884379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601e0eb-e96c-4c97-92ba-12d5f9dbdfe2 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.889703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95df80a-1692-47dc-878f-5195e701599f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:32.890658 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95df80a-1692-47dc-878f-5195e701599f admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.891021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95df80a-1692-47dc-878f-5195e701599f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.891207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95df80a-1692-47dc-878f-5195e701599f admin admin] PATH_INFO: `/v3/projects/1ccf2edff7f948eea02acc9bdf4fe456/users/e96c42827e39441ca5987ae129e449de/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.897182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-71f3dc7d-3b8a-49d8-bfbe-02821bb16e25 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:32.898430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-71f3dc7d-3b8a-49d8-bfbe-02821bb16e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.910916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95df80a-1692-47dc-878f-5195e701599f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ccf2edff7f948eea02acc9bdf4fe456, user_id=e96c42827e39441ca5987ae129e449de, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:32.916217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1062/2172] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:32.916217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3dc7d-3b8a-49d8-bfbe-02821bb16e25 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.916499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95df80a-1692-47dc-878f-5195e701599f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:32.920059 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3dc7d-3b8a-49d8-bfbe-02821bb16e25 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.924890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bc0a9-b1f1-42b3-80cc-f56ef88645b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:32.925532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bc0a9-b1f1-42b3-80cc-f56ef88645b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:32.925811 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bc0a9-b1f1-42b3-80cc-f56ef88645b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:32.926131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bc0a9-b1f1-42b3-80cc-f56ef88645b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:32.926876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bc0a9-b1f1-42b3-80cc-f56ef88645b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:32.927181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bc0a9-b1f1-42b3-80cc-f56ef88645b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:32.928760 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bc0a9-b1f1-42b3-80cc-f56ef88645b6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:32.939898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1063/2173] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:32.940846 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bc0a9-b1f1-42b3-80cc-f56ef88645b6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.942437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-813bc0a9-b1f1-42b3-80cc-f56ef88645b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:32.995317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1111/2174] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:32 2022] PUT /identity/v3/projects/1ccf2edff7f948eea02acc9bdf4fe456/users/e96c42827e39441ca5987ae129e449de/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:32.996266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95df80a-1692-47dc-878f-5195e701599f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:32.996883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bc0a9-b1f1-42b3-80cc-f56ef88645b6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:32.998044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f95df80a-1692-47dc-878f-5195e701599f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:33.053895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14814158-2167-47de-baa0-53283bfd917c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.054585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814158-2167-47de-baa0-53283bfd917c service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.054931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814158-2167-47de-baa0-53283bfd917c service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.055199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814158-2167-47de-baa0-53283bfd917c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.055919 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95df80a-1692-47dc-878f-5195e701599f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.059524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaf8d2-fcdd-4959-a061-ce3aaca553ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.060173 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaf8d2-fcdd-4959-a061-ce3aaca553ac service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.060443 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaf8d2-fcdd-4959-a061-ce3aaca553ac service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.060714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaf8d2-fcdd-4959-a061-ce3aaca553ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.121966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14814158-2167-47de-baa0-53283bfd917c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.123381 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaf8d2-fcdd-4959-a061-ce3aaca553ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.124122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14814158-2167-47de-baa0-53283bfd917c service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.124952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbaf8d2-fcdd-4959-a061-ce3aaca553ac service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.136513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1064/2175] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:33.136962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1112/2176] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:33.137838 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaf8d2-fcdd-4959-a061-ce3aaca553ac service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.138949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d6b5-4df0-4e7c-9415-38afe37a8753 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.139388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d6b5-4df0-4e7c-9415-38afe37a8753 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.139915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d6b5-4df0-4e7c-9415-38afe37a8753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.158546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaf8d2-fcdd-4959-a061-ce3aaca553ac service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.162064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9bb2d6b5-4df0-4e7c-9415-38afe37a8753 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:33.163300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9bb2d6b5-4df0-4e7c-9415-38afe37a8753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:33.164528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a44ff-e75b-4da3-98f7-c79de2435731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.165276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a44ff-e75b-4da3-98f7-c79de2435731 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.165648 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a44ff-e75b-4da3-98f7-c79de2435731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.166257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a44ff-e75b-4da3-98f7-c79de2435731 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.167272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a44ff-e75b-4da3-98f7-c79de2435731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.169492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a44ff-e75b-4da3-98f7-c79de2435731 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.172614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1065/2177] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:33.176101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8557d-a41f-4b5f-a0fd-5b33eb9888bb None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.176101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8557d-a41f-4b5f-a0fd-5b33eb9888bb None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.176101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8557d-a41f-4b5f-a0fd-5b33eb9888bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.207462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-66f8557d-a41f-4b5f-a0fd-5b33eb9888bb None None] MFA Rules not processed for user `e96c42827e39441ca5987ae129e449de`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:33.208778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-66f8557d-a41f-4b5f-a0fd-5b33eb9888bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:33.288860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1066/2178] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:33.288860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8557d-a41f-4b5f-a0fd-5b33eb9888bb None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.298719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8557d-a41f-4b5f-a0fd-5b33eb9888bb None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.307394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1113/2179] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:33 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:33.308047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a44ff-e75b-4da3-98f7-c79de2435731 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.309449 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e2c0e-3a6e-4d8c-ba43-99b8dacfbeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.310175 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e2c0e-3a6e-4d8c-ba43-99b8dacfbeee admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.310453 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e2c0e-3a6e-4d8c-ba43-99b8dacfbeee admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.310728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e2c0e-3a6e-4d8c-ba43-99b8dacfbeee admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.311512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e2c0e-3a6e-4d8c-ba43-99b8dacfbeee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:33.311771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e2c0e-3a6e-4d8c-ba43-99b8dacfbeee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.313928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e2c0e-3a6e-4d8c-ba43-99b8dacfbeee admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.328216 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1067/2180] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:33.330439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e2c0e-3a6e-4d8c-ba43-99b8dacfbeee admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.344780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e2c0e-3a6e-4d8c-ba43-99b8dacfbeee admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.376822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a44ff-e75b-4da3-98f7-c79de2435731 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.383291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1714871-b48a-4c1d-a4ad-c705584bc307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.384159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1714871-b48a-4c1d-a4ad-c705584bc307 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.384634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1714871-b48a-4c1d-a4ad-c705584bc307 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.385115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1714871-b48a-4c1d-a4ad-c705584bc307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.408462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e189f90-2d46-4439-9da8-34ddfa2edc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.409376 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e189f90-2d46-4439-9da8-34ddfa2edc6d admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.409663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e189f90-2d46-4439-9da8-34ddfa2edc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.410151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e189f90-2d46-4439-9da8-34ddfa2edc6d admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.410897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e189f90-2d46-4439-9da8-34ddfa2edc6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.420004 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e189f90-2d46-4439-9da8-34ddfa2edc6d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.460677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1714871-b48a-4c1d-a4ad-c705584bc307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.462955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1714871-b48a-4c1d-a4ad-c705584bc307 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.473815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1114/2181] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:57:33.474684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1714871-b48a-4c1d-a4ad-c705584bc307 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.488131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1714871-b48a-4c1d-a4ad-c705584bc307 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.499634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2990-d344-4403-a5ae-c77062f1c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.500304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2990-d344-4403-a5ae-c77062f1c1bf admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.500574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2990-d344-4403-a5ae-c77062f1c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.500913 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2990-d344-4403-a5ae-c77062f1c1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.506812 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1068/2182] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:33 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:33.506965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a2990-d344-4403-a5ae-c77062f1c1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.506965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a2990-d344-4403-a5ae-c77062f1c1bf admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.508842 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e189f90-2d46-4439-9da8-34ddfa2edc6d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.531644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e189f90-2d46-4439-9da8-34ddfa2edc6d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.537445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee893d37-b623-4d88-8312-440e995f9c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.540686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee893d37-b623-4d88-8312-440e995f9c80 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.540686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee893d37-b623-4d88-8312-440e995f9c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.540686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee893d37-b623-4d88-8312-440e995f9c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.540686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee893d37-b623-4d88-8312-440e995f9c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.541460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee893d37-b623-4d88-8312-440e995f9c80 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.556740 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1069/2183] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:33.558888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee893d37-b623-4d88-8312-440e995f9c80 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.575179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee893d37-b623-4d88-8312-440e995f9c80 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.575933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50166a-3751-4738-a002-8a2ebff4c7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.576609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50166a-3751-4738-a002-8a2ebff4c7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.576889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50166a-3751-4738-a002-8a2ebff4c7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.577159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50166a-3751-4738-a002-8a2ebff4c7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.578337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50166a-3751-4738-a002-8a2ebff4c7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.581219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50166a-3751-4738-a002-8a2ebff4c7f2 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.596011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1070/2184] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:33.606139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1115/2185] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:33 2022] POST /identity/v3/projects => generated 359 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:33.609775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50166a-3751-4738-a002-8a2ebff4c7f2 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.611323 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2990-d344-4403-a5ae-c77062f1c1bf admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.620315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50166a-3751-4738-a002-8a2ebff4c7f2 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.686420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fc33d-8156-4d93-b9bc-f6acb79db1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.687405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fc33d-8156-4d93-b9bc-f6acb79db1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.695911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fc33d-8156-4d93-b9bc-f6acb79db1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.695911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fc33d-8156-4d93-b9bc-f6acb79db1ba admin admin] PATH_INFO: `/v3/projects/284c0ecf58f04a2baf941e0d502c074d/users/859a2f8249fb47038b24e76ad1f73115/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.696990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2990-d344-4403-a5ae-c77062f1c1bf admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.698399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a44a8-b3cf-4ce9-bcb2-c4139b041f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.699226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a44a8-b3cf-4ce9-bcb2-c4139b041f81 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.699389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a44a8-b3cf-4ce9-bcb2-c4139b041f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.699672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a44a8-b3cf-4ce9-bcb2-c4139b041f81 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.700366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a44a8-b3cf-4ce9-bcb2-c4139b041f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.702394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a44a8-b3cf-4ce9-bcb2-c4139b041f81 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.706416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fc33d-8156-4d93-b9bc-f6acb79db1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=284c0ecf58f04a2baf941e0d502c074d, user_id=859a2f8249fb47038b24e76ad1f73115, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.709208 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fc33d-8156-4d93-b9bc-f6acb79db1ba admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.803088 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1071/2186] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:33 2022] PUT /identity/v3/projects/284c0ecf58f04a2baf941e0d502c074d/users/859a2f8249fb47038b24e76ad1f73115/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:33.803882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fc33d-8156-4d93-b9bc-f6acb79db1ba admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.805778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3c2fc33d-8156-4d93-b9bc-f6acb79db1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:33.834814 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1116/2187] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:33 2022] POST /identity/v3/users => generated 280 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:33.835838 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a44a8-b3cf-4ce9-bcb2-c4139b041f81 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:33.838119 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1b7a44a8-b3cf-4ce9-bcb2-c4139b041f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:33.851269 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a44a8-b3cf-4ce9-bcb2-c4139b041f81 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.874671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fc33d-8156-4d93-b9bc-f6acb79db1ba admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:33.880533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.881395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.881671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.881950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] PATH_INFO: `/v3/projects/98c7dc4f8d6740a996ee58a2acd96914` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.883164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c7dc4f8d6740a996ee58a2acd96914)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.885134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:33.906857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:33.907732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:33.908011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:33.908347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] PATH_INFO: `/v3/users/971e137352bb493eb4dea22d1c068366` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:33.910645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971e137352bb493eb4dea22d1c068366)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:33.912892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:34.063546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c7dc4f8d6740a996ee58a2acd96914', 'request_id': 'req-2c29edc4-087b-4ae8-a075-99840c6c0787'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.070133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c7dc4f8d6740a996ee58a2acd96914', 'request_id': 'req-2c29edc4-087b-4ae8-a075-99840c6c0787'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.075587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c7dc4f8d6740a996ee58a2acd96914', 'request_id': 'req-2c29edc4-087b-4ae8-a075-99840c6c0787'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.217845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] The token cache is being invalidate because project 98c7dc4f8d6740a996ee58a2acd96914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:34.218163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.218908 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2c29edc4-087b-4ae8-a075-99840c6c0787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.220614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1072/2188] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:33 2022] DELETE /identity/v3/projects/98c7dc4f8d6740a996ee58a2acd96914 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:34.222051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99911a8-ca38-4b65-b3f1-ac443d4ce595 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:34.222227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99911a8-ca38-4b65-b3f1-ac443d4ce595 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:34.222499 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99911a8-ca38-4b65-b3f1-ac443d4ce595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:34.248521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-c99911a8-ca38-4b65-b3f1-ac443d4ce595 None None] MFA Rules not processed for user `859a2f8249fb47038b24e76ad1f73115`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:34.249753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c99911a8-ca38-4b65-b3f1-ac443d4ce595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:34.262214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971e137352bb493eb4dea22d1c068366'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.276047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971e137352bb493eb4dea22d1c068366'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.318281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1073/2189] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:34.322742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99911a8-ca38-4b65-b3f1-ac443d4ce595 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:34.324061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c99911a8-ca38-4b65-b3f1-ac443d4ce595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:34.379450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971e137352bb493eb4dea22d1c068366'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.394154 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99911a8-ca38-4b65-b3f1-ac443d4ce595 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:34.395881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971e137352bb493eb4dea22d1c068366'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.396677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971e137352bb493eb4dea22d1c068366'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.402535 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de6571-3735-4fea-a863-d4607fea35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:34.403254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de6571-3735-4fea-a863-d4607fea35b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:34.403595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de6571-3735-4fea-a863-d4607fea35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:34.403875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de6571-3735-4fea-a863-d4607fea35b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:34.404664 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1117/2190] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:33 2022] DELETE /identity/v3/users/971e137352bb493eb4dea22d1c068366 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:34.405686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:34.406425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de6571-3735-4fea-a863-d4607fea35b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:34.407636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:34.408373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de6571-3735-4fea-a863-d4607fea35b7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:34.424224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1074/2191] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:34.425384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de6571-3735-4fea-a863-d4607fea35b7 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:34.428306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-71de6571-3735-4fea-a863-d4607fea35b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:34.442933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de6571-3735-4fea-a863-d4607fea35b7 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:34.477238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae90ba-64ab-407d-b28d-6d295e349016 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:34.481913 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:34.482889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:34.483171 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:34.483437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] PATH_INFO: `/v3/users/d72a4b2fcf274f609a7aa8a8aab1c09a` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:34.484779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72a4b2fcf274f609a7aa8a8aab1c09a)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:34.487473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:34.513407 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f22e0-4fa0-4d0d-b918-3abad6f03e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:34.514310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f22e0-4fa0-4d0d-b918-3abad6f03e86 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:34.514787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f22e0-4fa0-4d0d-b918-3abad6f03e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:34.515248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f22e0-4fa0-4d0d-b918-3abad6f03e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:34.516065 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f22e0-4fa0-4d0d-b918-3abad6f03e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:34.518831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f22e0-4fa0-4d0d-b918-3abad6f03e86 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:34.671172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1075/2192] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:34 2022] POST /identity/v3/projects => generated 371 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:34.672508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5ac5d-0d10-4a09-83bd-93eb2b0573da None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:34.672797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5ac5d-0d10-4a09-83bd-93eb2b0573da None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:34.673068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5ac5d-0d10-4a09-83bd-93eb2b0573da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:34.691180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-5fd5ac5d-0d10-4a09-83bd-93eb2b0573da None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:34.692362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5fd5ac5d-0d10-4a09-83bd-93eb2b0573da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:34.749579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1076/2193] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:34.750452 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5ac5d-0d10-4a09-83bd-93eb2b0573da None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:34.751890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5fd5ac5d-0d10-4a09-83bd-93eb2b0573da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:34.764138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5ac5d-0d10-4a09-83bd-93eb2b0573da None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:34.769465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bc8d6-a72c-49c4-9aec-213e0afa8c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:34.770144 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bc8d6-a72c-49c4-9aec-213e0afa8c29 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:34.770587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bc8d6-a72c-49c4-9aec-213e0afa8c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:34.770864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bc8d6-a72c-49c4-9aec-213e0afa8c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:34.771584 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bc8d6-a72c-49c4-9aec-213e0afa8c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:34.773172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bc8d6-a72c-49c4-9aec-213e0afa8c29 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:34.782864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1077/2194] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:34.783630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bc8d6-a72c-49c4-9aec-213e0afa8c29 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:34.793465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bc8d6-a72c-49c4-9aec-213e0afa8c29 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:34.795081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72a4b2fcf274f609a7aa8a8aab1c09a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.798254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac24e7-aa79-49f8-b788-c4796563e155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:34.798959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac24e7-aa79-49f8-b788-c4796563e155 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:34.799202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac24e7-aa79-49f8-b788-c4796563e155 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:34.799538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac24e7-aa79-49f8-b788-c4796563e155 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:34.800291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac24e7-aa79-49f8-b788-c4796563e155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:34.802185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72a4b2fcf274f609a7aa8a8aab1c09a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.802299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac24e7-aa79-49f8-b788-c4796563e155 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:34.920886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72a4b2fcf274f609a7aa8a8aab1c09a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.933801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72a4b2fcf274f609a7aa8a8aab1c09a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.934441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72a4b2fcf274f609a7aa8a8aab1c09a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:34.940723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1118/2195] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:34 2022] DELETE /identity/v3/users/d72a4b2fcf274f609a7aa8a8aab1c09a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:34.941518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:34.942899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:35.011610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1078/2196] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:34 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:35.011610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac24e7-aa79-49f8-b788-c4796563e155 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:35.011610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-37ac24e7-aa79-49f8-b788-c4796563e155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:35.019757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac24e7-aa79-49f8-b788-c4796563e155 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:35.019937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c45c40-8c96-49b1-bab1-b05c47eff4ba admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:35.024983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a56b1-dd7c-4018-90e0-ba8d21bd90b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:35.026288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a56b1-dd7c-4018-90e0-ba8d21bd90b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.026647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a56b1-dd7c-4018-90e0-ba8d21bd90b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.026999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a56b1-dd7c-4018-90e0-ba8d21bd90b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.029206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fa0a56b1-dd7c-4018-90e0-ba8d21bd90b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:35.081549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1c1a5-afb9-4780-94ac-181429d9cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:35.082581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1c1a5-afb9-4780-94ac-181429d9cc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.082918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1c1a5-afb9-4780-94ac-181429d9cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.083255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1c1a5-afb9-4780-94ac-181429d9cc7b admin admin] PATH_INFO: `/v3/projects/28c1d7c3b7244695ba07e6f0b5e90ab4/users/8988dedd944d489ba3173e74f5be8204/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.097960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1c1a5-afb9-4780-94ac-181429d9cc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c1d7c3b7244695ba07e6f0b5e90ab4, user_id=8988dedd944d489ba3173e74f5be8204, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:35.100749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1c1a5-afb9-4780-94ac-181429d9cc7b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:35.102028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a56b1-dd7c-4018-90e0-ba8d21bd90b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:35.103578 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a56b1-dd7c-4018-90e0-ba8d21bd90b5 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:35.113842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1119/2197] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:35.114723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a56b1-dd7c-4018-90e0-ba8d21bd90b5 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:35.116097 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fa0a56b1-dd7c-4018-90e0-ba8d21bd90b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:35.130281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a56b1-dd7c-4018-90e0-ba8d21bd90b5 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:35.133394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5db0c-75ea-4c79-855e-5078bff6d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:35.134078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5db0c-75ea-4c79-855e-5078bff6d183 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.134362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5db0c-75ea-4c79-855e-5078bff6d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.134633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5db0c-75ea-4c79-855e-5078bff6d183 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.135351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5db0c-75ea-4c79-855e-5078bff6d183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:35.137003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5db0c-75ea-4c79-855e-5078bff6d183 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:35.146968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1120/2198] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:35.150993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5db0c-75ea-4c79-855e-5078bff6d183 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:35.160872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5db0c-75ea-4c79-855e-5078bff6d183 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:35.165671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa166cf-9822-458e-8056-90111d63beaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:35.166578 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa166cf-9822-458e-8056-90111d63beaa admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.166965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa166cf-9822-458e-8056-90111d63beaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.167380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa166cf-9822-458e-8056-90111d63beaa admin admin] PATH_INFO: `/v3/projects/056f592136364eba8d3d6e9483314b1d/users/e012b680ae694159b4222d4fcb199647/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.182831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa166cf-9822-458e-8056-90111d63beaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=056f592136364eba8d3d6e9483314b1d, user_id=e012b680ae694159b4222d4fcb199647, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:35.185552 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa166cf-9822-458e-8056-90111d63beaa admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:35.233702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1079/2199] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:35 2022] PUT /identity/v3/projects/28c1d7c3b7244695ba07e6f0b5e90ab4/users/8988dedd944d489ba3173e74f5be8204/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:35.245549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d310be-e645-444a-8426-e85da74c97e0 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.245833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d310be-e645-444a-8426-e85da74c97e0 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.246228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d310be-e645-444a-8426-e85da74c97e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.260030 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1121/2200] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:35 2022] PUT /identity/v3/projects/056f592136364eba8d3d6e9483314b1d/users/e012b680ae694159b4222d4fcb199647/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:35.264013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa166cf-9822-458e-8056-90111d63beaa admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:35.280071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-73d310be-e645-444a-8426-e85da74c97e0 None None] MFA Rules not processed for user `8988dedd944d489ba3173e74f5be8204`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:35.281790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-73d310be-e645-444a-8426-e85da74c97e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:35.335723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa166cf-9822-458e-8056-90111d63beaa admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:35.343088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed160082-06af-4c28-aa10-bb6bcf5b52b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:35.343787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed160082-06af-4c28-aa10-bb6bcf5b52b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.344143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed160082-06af-4c28-aa10-bb6bcf5b52b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.344422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed160082-06af-4c28-aa10-bb6bcf5b52b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.345205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed160082-06af-4c28-aa10-bb6bcf5b52b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:35.347249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed160082-06af-4c28-aa10-bb6bcf5b52b9 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:35.363774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1080/2201] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:35.365521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d310be-e645-444a-8426-e85da74c97e0 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:35.369235 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1122/2202] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:35.394911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d310be-e645-444a-8426-e85da74c97e0 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:35.394911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f01c1-3787-4402-894b-760cd0a99e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:35.394911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f01c1-3787-4402-894b-760cd0a99e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.394911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f01c1-3787-4402-894b-760cd0a99e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.395294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f01c1-3787-4402-894b-760cd0a99e0f admin admin] PATH_INFO: `/v3/projects/056f592136364eba8d3d6e9483314b1d/users/e012b680ae694159b4222d4fcb199647/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.397494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f01c1-3787-4402-894b-760cd0a99e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=056f592136364eba8d3d6e9483314b1d, user_id=e012b680ae694159b4222d4fcb199647, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:35.404182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f01c1-3787-4402-894b-760cd0a99e0f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:35.417609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1081/2203] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:35 2022] PUT /identity/v3/projects/056f592136364eba8d3d6e9483314b1d/users/e012b680ae694159b4222d4fcb199647/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:35.417720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed160082-06af-4c28-aa10-bb6bcf5b52b9 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:35.419031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ed160082-06af-4c28-aa10-bb6bcf5b52b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:35.427530 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc939158-668b-4668-93f9-186480c1f7b4 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.427906 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc939158-668b-4668-93f9-186480c1f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.428140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc939158-668b-4668-93f9-186480c1f7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.463267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-bc939158-668b-4668-93f9-186480c1f7b4 None None] MFA Rules not processed for user `e012b680ae694159b4222d4fcb199647`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:35.466344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-bc939158-668b-4668-93f9-186480c1f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:35.486324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed160082-06af-4c28-aa10-bb6bcf5b52b9 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:35.547819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cfe5e-9ab2-4f9c-9cb5-d3dfba98c24f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:35.548466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cfe5e-9ab2-4f9c-9cb5-d3dfba98c24f service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.548745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cfe5e-9ab2-4f9c-9cb5-d3dfba98c24f service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.549015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cfe5e-9ab2-4f9c-9cb5-d3dfba98c24f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.561157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1082/2204] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:35.562731 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc939158-668b-4668-93f9-186480c1f7b4 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:35.564219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-bc939158-668b-4668-93f9-186480c1f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:35.621463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cfe5e-9ab2-4f9c-9cb5-d3dfba98c24f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:35.622937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cfe5e-9ab2-4f9c-9cb5-d3dfba98c24f service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:35.639208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1123/2205] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:35 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:35.650082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cfe5e-9ab2-4f9c-9cb5-d3dfba98c24f service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:35.660957 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc939158-668b-4668-93f9-186480c1f7b4 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:35.662293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cfe5e-9ab2-4f9c-9cb5-d3dfba98c24f service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:35.670081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:35.670962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.671243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.671520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] PATH_INFO: `/v3/users/8988dedd944d489ba3173e74f5be8204` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.672160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:35.672760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8988dedd944d489ba3173e74f5be8204)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:35.674074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:35.674498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:35.674829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] PATH_INFO: `/v3/projects/4292f432c2a44160be375593108ff2fa` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:35.675115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:35.676322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4292f432c2a44160be375593108ff2fa)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:35.679051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:35.929041 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8988dedd944d489ba3173e74f5be8204'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:35.930393 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4292f432c2a44160be375593108ff2fa', 'request_id': 'req-7c6587b5-2303-493a-89a5-7243d3b49f0f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:35.936774 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4292f432c2a44160be375593108ff2fa', 'request_id': 'req-7c6587b5-2303-493a-89a5-7243d3b49f0f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:35.937211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8988dedd944d489ba3173e74f5be8204'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:35.942625 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4292f432c2a44160be375593108ff2fa', 'request_id': 'req-7c6587b5-2303-493a-89a5-7243d3b49f0f'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.018821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8988dedd944d489ba3173e74f5be8204'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.031174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8988dedd944d489ba3173e74f5be8204'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.031828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8988dedd944d489ba3173e74f5be8204'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.038317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1124/2206] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:35 2022] DELETE /identity/v3/users/8988dedd944d489ba3173e74f5be8204 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:36.039105 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:36.040478 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:36.091850 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] The token cache is being invalidate because project 4292f432c2a44160be375593108ff2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:36.092146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.092760 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.094353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1083/2207] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:35 2022] DELETE /identity/v3/projects/4292f432c2a44160be375593108ff2fa => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:36.095097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:36.096511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:36.097068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f6f8d-5bd6-4c84-addb-7096ced2a21b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:36.100862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b01d2c-b436-4f95-9c7e-e598a15c6788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:36.101513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b01d2c-b436-4f95-9c7e-e598a15c6788 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:36.101793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b01d2c-b436-4f95-9c7e-e598a15c6788 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:36.102095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b01d2c-b436-4f95-9c7e-e598a15c6788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:36.103894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-06b01d2c-b436-4f95-9c7e-e598a15c6788 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:36.165108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6587b5-2303-493a-89a5-7243d3b49f0f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:36.166934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b01d2c-b436-4f95-9c7e-e598a15c6788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:36.168540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b01d2c-b436-4f95-9c7e-e598a15c6788 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:36.178048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1125/2208] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:36.179312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ab63-c2cb-4435-85ad-69fd27a4d7a8 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:36.179591 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ab63-c2cb-4435-85ad-69fd27a4d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:36.179859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ab63-c2cb-4435-85ad-69fd27a4d7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:36.197022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-7b62ab63-c2cb-4435-85ad-69fd27a4d7a8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:36.198392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7b62ab63-c2cb-4435-85ad-69fd27a4d7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:36.224259 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:36.225487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:36.225973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:36.226299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] PATH_INFO: `/v3/projects/2f1cb61601cc40c6bbcec42caf3f4f09` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:36.230248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1cb61601cc40c6bbcec42caf3f4f09)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:36.233519 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:36.260237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1126/2209] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:36.263556 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b1648-7a21-4fac-bbb9-056eb74b0c27 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:36.263858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b1648-7a21-4fac-bbb9-056eb74b0c27 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:36.264107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b1648-7a21-4fac-bbb9-056eb74b0c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:36.282850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-396b1648-7a21-4fac-bbb9-056eb74b0c27 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:36.284131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-396b1648-7a21-4fac-bbb9-056eb74b0c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:36.292149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1127/2210] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:36.292962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b1648-7a21-4fac-bbb9-056eb74b0c27 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:36.294206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-396b1648-7a21-4fac-bbb9-056eb74b0c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:36.353265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1cb61601cc40c6bbcec42caf3f4f09', 'request_id': 'req-64ce6e7b-eb90-4859-8c3a-7d911cb57544'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.357505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b1648-7a21-4fac-bbb9-056eb74b0c27 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:36.360200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1cb61601cc40c6bbcec42caf3f4f09', 'request_id': 'req-64ce6e7b-eb90-4859-8c3a-7d911cb57544'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.366036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1cb61601cc40c6bbcec42caf3f4f09', 'request_id': 'req-64ce6e7b-eb90-4859-8c3a-7d911cb57544'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.404813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5dc89-49b1-4f04-91d7-8559600f935a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:36.405472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5dc89-49b1-4f04-91d7-8559600f935a service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:36.405745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5dc89-49b1-4f04-91d7-8559600f935a service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:36.406111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5dc89-49b1-4f04-91d7-8559600f935a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:36.455912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] The token cache is being invalidate because project 2f1cb61601cc40c6bbcec42caf3f4f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:36.456211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.456851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-64ce6e7b-eb90-4859-8c3a-7d911cb57544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.461549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1084/2211] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:36 2022] DELETE /identity/v3/projects/2f1cb61601cc40c6bbcec42caf3f4f09 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:36.461549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ef084-1965-4e97-b1dc-be08eb9c401b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:36.461549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ef084-1965-4e97-b1dc-be08eb9c401b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:36.461549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ef084-1965-4e97-b1dc-be08eb9c401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:36.471762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5dc89-49b1-4f04-91d7-8559600f935a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:36.473294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5dc89-49b1-4f04-91d7-8559600f935a service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:36.480128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-823ef084-1965-4e97-b1dc-be08eb9c401b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:36.484256 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-823ef084-1965-4e97-b1dc-be08eb9c401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:36.484395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1128/2212] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:36.484657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5dc89-49b1-4f04-91d7-8559600f935a service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:36.494512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1085/2213] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:36.495032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5dc89-49b1-4f04-91d7-8559600f935a service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:36.495997 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ef084-1965-4e97-b1dc-be08eb9c401b None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:36.499643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:36.500523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:36.500783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:36.501051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] PATH_INFO: `/v3/users/881f8f51c9c440d4a8fbe6de2493689b` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:36.502631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=881f8f51c9c440d4a8fbe6de2493689b)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:36.504765 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:36.506665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ef084-1965-4e97-b1dc-be08eb9c401b None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:36.512086 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d22713-62ec-4f4d-8e63-fc1271daab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:36.512688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22713-62ec-4f4d-8e63-fc1271daab80 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:36.512980 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22713-62ec-4f4d-8e63-fc1271daab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:36.513243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22713-62ec-4f4d-8e63-fc1271daab80 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:36.519603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d22713-62ec-4f4d-8e63-fc1271daab80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:36.520634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d22713-62ec-4f4d-8e63-fc1271daab80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:36.523044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d22713-62ec-4f4d-8e63-fc1271daab80 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:36.540482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1086/2214] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:36.541523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d22713-62ec-4f4d-8e63-fc1271daab80 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:36.552081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d22713-62ec-4f4d-8e63-fc1271daab80 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:36.557078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79247e0f-ef14-443e-97f4-298848d4f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:36.557805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79247e0f-ef14-443e-97f4-298848d4f876 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:36.558123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79247e0f-ef14-443e-97f4-298848d4f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:36.558395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79247e0f-ef14-443e-97f4-298848d4f876 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:36.559106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79247e0f-ef14-443e-97f4-298848d4f876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:36.561027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79247e0f-ef14-443e-97f4-298848d4f876 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:36.688255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1087/2215] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:36 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:36.691903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79247e0f-ef14-443e-97f4-298848d4f876 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:36.734471 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881f8f51c9c440d4a8fbe6de2493689b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.743808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881f8f51c9c440d4a8fbe6de2493689b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.799177 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79247e0f-ef14-443e-97f4-298848d4f876 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:36.810980 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669621b1-6cfd-4172-824b-7300703a7363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:36.811821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669621b1-6cfd-4172-824b-7300703a7363 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:36.812350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669621b1-6cfd-4172-824b-7300703a7363 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:36.812725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669621b1-6cfd-4172-824b-7300703a7363 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:36.813811 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669621b1-6cfd-4172-824b-7300703a7363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:36.816992 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669621b1-6cfd-4172-824b-7300703a7363 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:36.835997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881f8f51c9c440d4a8fbe6de2493689b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.860934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881f8f51c9c440d4a8fbe6de2493689b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.862566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881f8f51c9c440d4a8fbe6de2493689b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:36.870420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1129/2216] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:36 2022] DELETE /identity/v3/users/881f8f51c9c440d4a8fbe6de2493689b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:36.916747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1088/2217] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:36 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:36.920803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:36.922226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.002487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669621b1-6cfd-4172-824b-7300703a7363 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:37.005039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-669621b1-6cfd-4172-824b-7300703a7363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.009925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd830295-a577-4f1c-abb6-569b270ea99f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:37.014905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912f96-ec9b-404a-ae21-5996df7e4b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:37.015506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912f96-ec9b-404a-ae21-5996df7e4b94 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.015786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912f96-ec9b-404a-ae21-5996df7e4b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.016057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6912f96-ec9b-404a-ae21-5996df7e4b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.016866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912f96-ec9b-404a-ae21-5996df7e4b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:37.018581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6912f96-ec9b-404a-ae21-5996df7e4b94 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:37.028515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669621b1-6cfd-4172-824b-7300703a7363 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:37.037391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:37.039167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.039167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.039389 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] PATH_INFO: `/v3/projects/28c1d7c3b7244695ba07e6f0b5e90ab4` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.040698 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c1d7c3b7244695ba07e6f0b5e90ab4)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:37.043007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:37.060914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1130/2218] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:37.070758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912f96-ec9b-404a-ae21-5996df7e4b94 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:37.088963 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6912f96-ec9b-404a-ae21-5996df7e4b94 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:37.095673 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e712e-dc3f-4b01-aedd-40c7975bd235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:37.096980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e712e-dc3f-4b01-aedd-40c7975bd235 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.097151 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e712e-dc3f-4b01-aedd-40c7975bd235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.097422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e712e-dc3f-4b01-aedd-40c7975bd235 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.098490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e712e-dc3f-4b01-aedd-40c7975bd235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:37.100085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e712e-dc3f-4b01-aedd-40c7975bd235 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:37.111340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1131/2219] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:37.119828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e712e-dc3f-4b01-aedd-40c7975bd235 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:37.133282 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e712e-dc3f-4b01-aedd-40c7975bd235 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:37.138480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94a81e-64f1-4188-bb49-97cbcaa431ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:37.139354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94a81e-64f1-4188-bb49-97cbcaa431ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.139632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94a81e-64f1-4188-bb49-97cbcaa431ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.139958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94a81e-64f1-4188-bb49-97cbcaa431ad admin admin] PATH_INFO: `/v3/projects/5c6353e349e848ea94e626778af4f42e/users/584054d788c0404ba6275c27888c7ca4/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.155174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94a81e-64f1-4188-bb49-97cbcaa431ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6353e349e848ea94e626778af4f42e, user_id=584054d788c0404ba6275c27888c7ca4, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:37.158253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94a81e-64f1-4188-bb49-97cbcaa431ad admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:37.306040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1132/2220] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:37 2022] PUT /identity/v3/projects/5c6353e349e848ea94e626778af4f42e/users/584054d788c0404ba6275c27888c7ca4/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:37.314872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c1d7c3b7244695ba07e6f0b5e90ab4', 'request_id': 'req-dc3266fe-db0c-464d-924f-bb72e980fdf3'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.322549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c1d7c3b7244695ba07e6f0b5e90ab4', 'request_id': 'req-dc3266fe-db0c-464d-924f-bb72e980fdf3'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.333302 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84a31f-5d5c-4584-9d0a-788d831c2235 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.333302 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84a31f-5d5c-4584-9d0a-788d831c2235 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.333302 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84a31f-5d5c-4584-9d0a-788d831c2235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.333597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c1d7c3b7244695ba07e6f0b5e90ab4', 'request_id': 'req-dc3266fe-db0c-464d-924f-bb72e980fdf3'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.364648 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-7b84a31f-5d5c-4584-9d0a-788d831c2235 None None] MFA Rules not processed for user `584054d788c0404ba6275c27888c7ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:37.365968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7b84a31f-5d5c-4584-9d0a-788d831c2235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.430916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] The token cache is being invalidate because project 28c1d7c3b7244695ba07e6f0b5e90ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:37.431075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.431582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.433521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1089/2221] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:37 2022] DELETE /identity/v3/projects/28c1d7c3b7244695ba07e6f0b5e90ab4 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:37.434442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:37.435753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.441685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1133/2222] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:37.443166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a5c4a-120d-4fbd-9eca-dbb73a0ffee9 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.443458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a5c4a-120d-4fbd-9eca-dbb73a0ffee9 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.443744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a5c4a-120d-4fbd-9eca-dbb73a0ffee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.468194 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-a37a5c4a-120d-4fbd-9eca-dbb73a0ffee9 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:37.469559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a37a5c4a-120d-4fbd-9eca-dbb73a0ffee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.510834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3266fe-db0c-464d-924f-bb72e980fdf3 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:37.515471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:37.516361 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.516777 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.517055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] PATH_INFO: `/v3/users/859a2f8249fb47038b24e76ad1f73115` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.519170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=859a2f8249fb47038b24e76ad1f73115)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:37.521142 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:37.528820 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1134/2223] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:37.534640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a5c4a-120d-4fbd-9eca-dbb73a0ffee9 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:37.538382 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a37a5c4a-120d-4fbd-9eca-dbb73a0ffee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.598718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a5c4a-120d-4fbd-9eca-dbb73a0ffee9 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:37.602394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e97d33-f513-4c9f-b736-a67417997300 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500eaf6aadff441ca1e535443e1d8c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:37.603034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e97d33-f513-4c9f-b736-a67417997300 service glance] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.603315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e97d33-f513-4c9f-b736-a67417997300 service glance] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.603587 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e97d33-f513-4c9f-b736-a67417997300 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.605419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-53e97d33-f513-4c9f-b736-a67417997300 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.617599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e97d33-f513-4c9f-b736-a67417997300 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:37.619360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e97d33-f513-4c9f-b736-a67417997300 service glance] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:37.628967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1135/2224] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:37.629747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e97d33-f513-4c9f-b736-a67417997300 service glance] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:37.631099 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-53e97d33-f513-4c9f-b736-a67417997300 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.644470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e97d33-f513-4c9f-b736-a67417997300 service glance] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:37.649124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:37.650163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.650448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.650721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] PATH_INFO: `/v3/projects/f9e527fca86d4e8fa2d9c1212ae7339a` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.652048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e527fca86d4e8fa2d9c1212ae7339a)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:37.653979 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:37.746786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859a2f8249fb47038b24e76ad1f73115'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.747482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859a2f8249fb47038b24e76ad1f73115'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.780364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e527fca86d4e8fa2d9c1212ae7339a', 'request_id': 'req-e63ca96b-efff-4edb-b321-192363404b6e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.786590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e527fca86d4e8fa2d9c1212ae7339a', 'request_id': 'req-e63ca96b-efff-4edb-b321-192363404b6e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.824213 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859a2f8249fb47038b24e76ad1f73115'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.832509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859a2f8249fb47038b24e76ad1f73115'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.844771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-afa8dff2-23db-4d08-a957-86660ff826d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859a2f8249fb47038b24e76ad1f73115'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.851301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1090/2225] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:37 2022] DELETE /identity/v3/users/859a2f8249fb47038b24e76ad1f73115 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:37.852513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd80c3-00ea-4737-8579-582ebaf096d4 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.852803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd80c3-00ea-4737-8579-582ebaf096d4 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.854817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd80c3-00ea-4737-8579-582ebaf096d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.869698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e527fca86d4e8fa2d9c1212ae7339a', 'request_id': 'req-e63ca96b-efff-4edb-b321-192363404b6e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.872150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-36fd80c3-00ea-4737-8579-582ebaf096d4 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:37.873350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-36fd80c3-00ea-4737-8579-582ebaf096d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.883257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] The token cache is being invalidate because project f9e527fca86d4e8fa2d9c1212ae7339a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:37.883549 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.884349 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e63ca96b-efff-4edb-b321-192363404b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:37.886010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1136/2226] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:37 2022] DELETE /identity/v3/projects/f9e527fca86d4e8fa2d9c1212ae7339a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:37.887415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcde2c-a646-4b4f-887d-221325afdfc2 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.887865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcde2c-a646-4b4f-887d-221325afdfc2 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.888142 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcde2c-a646-4b4f-887d-221325afdfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.907598 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-a2dcde2c-a646-4b4f-887d-221325afdfc2 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:37.909479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a2dcde2c-a646-4b4f-887d-221325afdfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.951182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1091/2227] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:37.952322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b72f-5114-42ba-9bec-bbca2d403b99 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:37.952995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b72f-5114-42ba-9bec-bbca2d403b99 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:37.952995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b72f-5114-42ba-9bec-bbca2d403b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:37.975617 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-44b8b72f-5114-42ba-9bec-bbca2d403b99 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:37.976816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-44b8b72f-5114-42ba-9bec-bbca2d403b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:37.980355 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1137/2228] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:37.981208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcde2c-a646-4b4f-887d-221325afdfc2 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:37.991746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcde2c-a646-4b4f-887d-221325afdfc2 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:37.993308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1092/2229] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:37.993427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8b72f-5114-42ba-9bec-bbca2d403b99 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:37.994857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-44b8b72f-5114-42ba-9bec-bbca2d403b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:38.002008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501da79-97c3-4e0c-bfda-b265658fbc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.002899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501da79-97c3-4e0c-bfda-b265658fbc0d admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.003303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501da79-97c3-4e0c-bfda-b265658fbc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.003624 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501da79-97c3-4e0c-bfda-b265658fbc0d admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.004447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501da79-97c3-4e0c-bfda-b265658fbc0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:38.004753 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501da79-97c3-4e0c-bfda-b265658fbc0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.006515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501da79-97c3-4e0c-bfda-b265658fbc0d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.019417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1138/2230] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:38.020716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e117c-269f-4dc4-ae59-e3c20066d0fb None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.021000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e117c-269f-4dc4-ae59-e3c20066d0fb None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.023914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e117c-269f-4dc4-ae59-e3c20066d0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.040602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-395e117c-269f-4dc4-ae59-e3c20066d0fb None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:38.041744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-395e117c-269f-4dc4-ae59-e3c20066d0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:38.050452 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1139/2231] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:38.051367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e117c-269f-4dc4-ae59-e3c20066d0fb None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.062177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e117c-269f-4dc4-ae59-e3c20066d0fb None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.068001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372ad2-06da-41a3-8e98-7b9de9aaae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.071375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8b72f-5114-42ba-9bec-bbca2d403b99 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.075114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf867fd-5491-478d-af03-a1ded5a459f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.075758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf867fd-5491-478d-af03-a1ded5a459f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.076095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf867fd-5491-478d-af03-a1ded5a459f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.076304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf867fd-5491-478d-af03-a1ded5a459f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.079546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372ad2-06da-41a3-8e98-7b9de9aaae7e admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.080300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372ad2-06da-41a3-8e98-7b9de9aaae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.081335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372ad2-06da-41a3-8e98-7b9de9aaae7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.082487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4372ad2-06da-41a3-8e98-7b9de9aaae7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.084738 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4372ad2-06da-41a3-8e98-7b9de9aaae7e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.102444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf867fd-5491-478d-af03-a1ded5a459f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.102444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf867fd-5491-478d-af03-a1ded5a459f6 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.102607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1093/2232] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:38.103746 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf867fd-5491-478d-af03-a1ded5a459f6 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.114405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf867fd-5491-478d-af03-a1ded5a459f6 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.120069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4d13-c90e-46ca-bb2a-705d4bd609cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.120543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4d13-c90e-46ca-bb2a-705d4bd609cb admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.120894 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4d13-c90e-46ca-bb2a-705d4bd609cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.121279 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4d13-c90e-46ca-bb2a-705d4bd609cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.122219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb4d13-c90e-46ca-bb2a-705d4bd609cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:38.122665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb4d13-c90e-46ca-bb2a-705d4bd609cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.124520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb4d13-c90e-46ca-bb2a-705d4bd609cb admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.142409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1094/2233] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:38.147331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4d13-c90e-46ca-bb2a-705d4bd609cb admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.157202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb4d13-c90e-46ca-bb2a-705d4bd609cb admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.162374 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9f0ce-e057-44e2-ac40-bc15b34a3fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.164576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9f0ce-e057-44e2-ac40-bc15b34a3fdd admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.164576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9f0ce-e057-44e2-ac40-bc15b34a3fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.164576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9f0ce-e057-44e2-ac40-bc15b34a3fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.164576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9f0ce-e057-44e2-ac40-bc15b34a3fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.166169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9f0ce-e057-44e2-ac40-bc15b34a3fdd admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.193291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1140/2234] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:38 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:38.197376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372ad2-06da-41a3-8e98-7b9de9aaae7e admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.259117 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372ad2-06da-41a3-8e98-7b9de9aaae7e admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.263865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee47d7-9ce8-41ed-aac9-e78f88f444b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.264516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee47d7-9ce8-41ed-aac9-e78f88f444b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.264795 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee47d7-9ce8-41ed-aac9-e78f88f444b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.265065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee47d7-9ce8-41ed-aac9-e78f88f444b7 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.265740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee47d7-9ce8-41ed-aac9-e78f88f444b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.267661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee47d7-9ce8-41ed-aac9-e78f88f444b7 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.280421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1095/2235] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:38 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:38.281413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9f0ce-e057-44e2-ac40-bc15b34a3fdd admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.354447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9f0ce-e057-44e2-ac40-bc15b34a3fdd admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.359163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feff16-035f-41b7-b8b0-ea3ae1f9604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.359845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feff16-035f-41b7-b8b0-ea3ae1f9604e admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.360127 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feff16-035f-41b7-b8b0-ea3ae1f9604e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.360403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feff16-035f-41b7-b8b0-ea3ae1f9604e admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.361092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feff16-035f-41b7-b8b0-ea3ae1f9604e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.363603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feff16-035f-41b7-b8b0-ea3ae1f9604e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.412877 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1141/2236] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:38 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:38.416822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee47d7-9ce8-41ed-aac9-e78f88f444b7 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.427483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee47d7-9ce8-41ed-aac9-e78f88f444b7 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.432335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb5f0f-a936-4ef0-ab03-f148de0bf3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.432992 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5f0f-a936-4ef0-ab03-f148de0bf3db admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.433268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5f0f-a936-4ef0-ab03-f148de0bf3db admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.433540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5f0f-a936-4ef0-ab03-f148de0bf3db admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.434286 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb5f0f-a936-4ef0-ab03-f148de0bf3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.435961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb5f0f-a936-4ef0-ab03-f148de0bf3db admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.446605 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1142/2237] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:38.450029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb5f0f-a936-4ef0-ab03-f148de0bf3db admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.459750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb5f0f-a936-4ef0-ab03-f148de0bf3db admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.465076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17690a72-d1f3-4219-8790-5a207c132cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.465744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17690a72-d1f3-4219-8790-5a207c132cad admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.466055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17690a72-d1f3-4219-8790-5a207c132cad admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.466328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17690a72-d1f3-4219-8790-5a207c132cad admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.467038 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17690a72-d1f3-4219-8790-5a207c132cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.468635 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17690a72-d1f3-4219-8790-5a207c132cad admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.479681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1143/2238] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:38.483794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17690a72-d1f3-4219-8790-5a207c132cad admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.493845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17690a72-d1f3-4219-8790-5a207c132cad admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.498512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e6b69-ec2c-43c9-8db4-f5274268c0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.503134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e6b69-ec2c-43c9-8db4-f5274268c0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.503134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e6b69-ec2c-43c9-8db4-f5274268c0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.503134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e6b69-ec2c-43c9-8db4-f5274268c0f7 admin admin] PATH_INFO: `/v3/projects/5b1a09dd6a734ed8bd2be3f884bb7de4/users/15c1e6bcd5334f99b5a0e792510f4808/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.513826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e6b69-ec2c-43c9-8db4-f5274268c0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1a09dd6a734ed8bd2be3f884bb7de4, user_id=15c1e6bcd5334f99b5a0e792510f4808, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.516501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e6b69-ec2c-43c9-8db4-f5274268c0f7 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.560528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1096/2239] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:38 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:38.560528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feff16-035f-41b7-b8b0-ea3ae1f9604e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.569034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feff16-035f-41b7-b8b0-ea3ae1f9604e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.574294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aca35c-184f-42be-939e-3be1c28d7d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.574987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aca35c-184f-42be-939e-3be1c28d7d13 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.575262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aca35c-184f-42be-939e-3be1c28d7d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.575532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aca35c-184f-42be-939e-3be1c28d7d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.576329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aca35c-184f-42be-939e-3be1c28d7d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.578190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aca35c-184f-42be-939e-3be1c28d7d13 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.589778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1097/2240] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:38.593369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aca35c-184f-42be-939e-3be1c28d7d13 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.609149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aca35c-184f-42be-939e-3be1c28d7d13 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.614955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33989d-640d-429f-b5bc-ac969836196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.615688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33989d-640d-429f-b5bc-ac969836196e admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.615951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33989d-640d-429f-b5bc-ac969836196e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.617960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33989d-640d-429f-b5bc-ac969836196e admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.617960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33989d-640d-429f-b5bc-ac969836196e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.618764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33989d-640d-429f-b5bc-ac969836196e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.635548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1098/2241] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:38.635548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33989d-640d-429f-b5bc-ac969836196e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.636776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7f33989d-640d-429f-b5bc-ac969836196e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:38.655149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33989d-640d-429f-b5bc-ac969836196e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.659746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1144/2242] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:38 2022] PUT /identity/v3/projects/5b1a09dd6a734ed8bd2be3f884bb7de4/users/15c1e6bcd5334f99b5a0e792510f4808/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:38.659746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e6b69-ec2c-43c9-8db4-f5274268c0f7 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.725123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.726226 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.726572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.726915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] PATH_INFO: `/v3/projects/284c0ecf58f04a2baf941e0d502c074d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.728289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=284c0ecf58f04a2baf941e0d502c074d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.730262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.730976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e6b69-ec2c-43c9-8db4-f5274268c0f7 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:38.735962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8de18-723d-442b-a25b-fb9107e1655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:38.737001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8de18-723d-442b-a25b-fb9107e1655b admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.737249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8de18-723d-442b-a25b-fb9107e1655b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.737523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8de18-723d-442b-a25b-fb9107e1655b admin admin] PATH_INFO: `/v3/projects/c6edac36081b47b9884557d4373fc3d4/users/8145edc2e03c4afbb9f46e819931f642/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.753922 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8de18-723d-442b-a25b-fb9107e1655b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6edac36081b47b9884557d4373fc3d4, user_id=8145edc2e03c4afbb9f46e819931f642, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:38.756666 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8de18-723d-442b-a25b-fb9107e1655b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:38.853568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1145/2243] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:38 2022] PUT /identity/v3/projects/c6edac36081b47b9884557d4373fc3d4/users/8145edc2e03c4afbb9f46e819931f642/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:38.855261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070feb98-fed1-4cb7-9106-778da950c101 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.855612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070feb98-fed1-4cb7-9106-778da950c101 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.855889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070feb98-fed1-4cb7-9106-778da950c101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.865485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284c0ecf58f04a2baf941e0d502c074d', 'request_id': 'req-58f8b8d4-6152-4095-a439-acb3264e4eae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:38.871903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284c0ecf58f04a2baf941e0d502c074d', 'request_id': 'req-58f8b8d4-6152-4095-a439-acb3264e4eae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:38.877755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284c0ecf58f04a2baf941e0d502c074d', 'request_id': 'req-58f8b8d4-6152-4095-a439-acb3264e4eae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:38.884720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-070feb98-fed1-4cb7-9106-778da950c101 None None] MFA Rules not processed for user `15c1e6bcd5334f99b5a0e792510f4808`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:38.885930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-070feb98-fed1-4cb7-9106-778da950c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:38.949239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1146/2244] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:38.950604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd554-90e9-4d46-aab0-08411d01658e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:38.950891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd554-90e9-4d46-aab0-08411d01658e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:38.951165 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd554-90e9-4d46-aab0-08411d01658e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:38.972725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] The token cache is being invalidate because project 284c0ecf58f04a2baf941e0d502c074d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:38.973014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:38.973676 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:38.975431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1099/2245] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:38 2022] DELETE /identity/v3/projects/284c0ecf58f04a2baf941e0d502c074d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:38.976179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:38.977566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:38.981220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4ffdd554-90e9-4d46-aab0-08411d01658e None None] MFA Rules not processed for user `8145edc2e03c4afbb9f46e819931f642`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:38.982507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4ffdd554-90e9-4d46-aab0-08411d01658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:39.039539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8b8d4-6152-4095-a439-acb3264e4eae admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:39.044576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fdcf6-cbee-4873-af12-778178621ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:39.045333 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fdcf6-cbee-4873-af12-778178621ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:39.045619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fdcf6-cbee-4873-af12-778178621ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:39.045897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fdcf6-cbee-4873-af12-778178621ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:39.046620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fdcf6-cbee-4873-af12-778178621ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:39.048538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fdcf6-cbee-4873-af12-778178621ed2 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:39.051345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1147/2246] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:39.055492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd554-90e9-4d46-aab0-08411d01658e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:39.056883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4ffdd554-90e9-4d46-aab0-08411d01658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:39.071267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd554-90e9-4d46-aab0-08411d01658e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:39.076352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:39.077219 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:39.077498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:39.077773 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] PATH_INFO: `/v3/users/e012b680ae694159b4222d4fcb199647` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:39.079007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e012b680ae694159b4222d4fcb199647)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:39.081688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:39.167955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1100/2247] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:38 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:39.168796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fdcf6-cbee-4873-af12-778178621ed2 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:39.170508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a72fdcf6-cbee-4873-af12-778178621ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:39.225337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fdcf6-cbee-4873-af12-778178621ed2 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:39.229139 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf58547-cf26-4167-b4f4-dc83e4639e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:39.229779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58547-cf26-4167-b4f4-dc83e4639e41 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:39.230137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58547-cf26-4167-b4f4-dc83e4639e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:39.230415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58547-cf26-4167-b4f4-dc83e4639e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:39.285808 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf58547-cf26-4167-b4f4-dc83e4639e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:39.287347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf58547-cf26-4167-b4f4-dc83e4639e41 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:39.296021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1101/2248] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:39.296956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf58547-cf26-4167-b4f4-dc83e4639e41 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:39.324782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e012b680ae694159b4222d4fcb199647'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:39.334394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e012b680ae694159b4222d4fcb199647'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:39.360915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf58547-cf26-4167-b4f4-dc83e4639e41 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:39.366471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c88ab-01c3-4695-a008-241e602bf8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:39.367197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c88ab-01c3-4695-a008-241e602bf8bc admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:39.367612 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c88ab-01c3-4695-a008-241e602bf8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:39.367872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c88ab-01c3-4695-a008-241e602bf8bc admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:39.368594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c88ab-01c3-4695-a008-241e602bf8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:39.370635 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c88ab-01c3-4695-a008-241e602bf8bc admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:39.424007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e012b680ae694159b4222d4fcb199647'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:39.436749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e012b680ae694159b4222d4fcb199647'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:39.437397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e012b680ae694159b4222d4fcb199647'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:39.443355 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1148/2249] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:39 2022] DELETE /identity/v3/users/e012b680ae694159b4222d4fcb199647 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:39.452631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1102/2250] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:39 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:39.460663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:39.462291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:39.527586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502cdc3-8b9b-4262-b63f-d63deca762ce admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:39.532308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed18ad2-87c6-478c-bccd-2f06776d2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:39.532976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed18ad2-87c6-478c-bccd-2f06776d2a46 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:39.533254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed18ad2-87c6-478c-bccd-2f06776d2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:39.533532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed18ad2-87c6-478c-bccd-2f06776d2a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:39.534944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed18ad2-87c6-478c-bccd-2f06776d2a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:39.536809 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed18ad2-87c6-478c-bccd-2f06776d2a46 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:39.547072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1149/2251] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:39.551661 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c88ab-01c3-4695-a008-241e602bf8bc admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:39.562169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c88ab-01c3-4695-a008-241e602bf8bc admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:39.567345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080f11b-d571-4caa-8504-29d56d448ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:39.567997 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080f11b-d571-4caa-8504-29d56d448ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:39.568276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080f11b-d571-4caa-8504-29d56d448ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:39.568548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080f11b-d571-4caa-8504-29d56d448ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:39.569306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080f11b-d571-4caa-8504-29d56d448ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:39.570932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080f11b-d571-4caa-8504-29d56d448ab8 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:39.582491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1103/2252] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:39.586680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed18ad2-87c6-478c-bccd-2f06776d2a46 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:39.597255 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed18ad2-87c6-478c-bccd-2f06776d2a46 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:39.601896 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f653-0552-4a4b-98ee-1122a4c8991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:39.602795 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f653-0552-4a4b-98ee-1122a4c8991f admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:39.605818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f653-0552-4a4b-98ee-1122a4c8991f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:39.605818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f653-0552-4a4b-98ee-1122a4c8991f admin admin] PATH_INFO: `/v3/projects/a91c1449934249af82746f72850ae539/users/fb703085327d497fa5adc65621b912ec/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:39.617611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740f653-0552-4a4b-98ee-1122a4c8991f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91c1449934249af82746f72850ae539, user_id=fb703085327d497fa5adc65621b912ec, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:39.620205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740f653-0552-4a4b-98ee-1122a4c8991f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:39.722778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1150/2253] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:39 2022] PUT /identity/v3/projects/a91c1449934249af82746f72850ae539/users/fb703085327d497fa5adc65621b912ec/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:39.734599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b2e31-be9f-4bc9-98af-7b518d604565 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:39.735094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b2e31-be9f-4bc9-98af-7b518d604565 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:39.735541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b2e31-be9f-4bc9-98af-7b518d604565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:39.777706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-503b2e31-be9f-4bc9-98af-7b518d604565 None None] MFA Rules not processed for user `fb703085327d497fa5adc65621b912ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:39.779164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-503b2e31-be9f-4bc9-98af-7b518d604565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:39.875619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1104/2254] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:39.881184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f653-0552-4a4b-98ee-1122a4c8991f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:39.942202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f653-0552-4a4b-98ee-1122a4c8991f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:39.946824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae398c2-c773-46d2-9391-8a8627805355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:39.947468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae398c2-c773-46d2-9391-8a8627805355 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:39.947747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae398c2-c773-46d2-9391-8a8627805355 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:39.948135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae398c2-c773-46d2-9391-8a8627805355 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:39.948816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae398c2-c773-46d2-9391-8a8627805355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:39.950758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae398c2-c773-46d2-9391-8a8627805355 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:39.968750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b2e31-be9f-4bc9-98af-7b518d604565 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:39.971959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-503b2e31-be9f-4bc9-98af-7b518d604565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:39.984508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b2e31-be9f-4bc9-98af-7b518d604565 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:39.989629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:39.990538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:39.990821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:39.991095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] PATH_INFO: `/v3/projects/056f592136364eba8d3d6e9483314b1d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:39.992361 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=056f592136364eba8d3d6e9483314b1d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:39.995113 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.100274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1151/2255] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:39 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:40.103825 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae398c2-c773-46d2-9391-8a8627805355 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.161552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056f592136364eba8d3d6e9483314b1d', 'request_id': 'req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:40.169307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056f592136364eba8d3d6e9483314b1d', 'request_id': 'req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:40.177101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056f592136364eba8d3d6e9483314b1d', 'request_id': 'req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:40.196588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae398c2-c773-46d2-9391-8a8627805355 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.249813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] The token cache is being invalidate because project 056f592136364eba8d3d6e9483314b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:40.250143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:40.251838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9cd692fe-a5dc-4e7a-ae46-5f64b7a71a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:40.254089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1105/2256] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:39 2022] DELETE /identity/v3/projects/056f592136364eba8d3d6e9483314b1d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:40.258869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf19b-57ae-4679-b3bf-6283faec85d8 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.259050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add37b0-7431-4d9f-ae58-c51a56905c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.259285 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf19b-57ae-4679-b3bf-6283faec85d8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.259515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf19b-57ae-4679-b3bf-6283faec85d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.259747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add37b0-7431-4d9f-ae58-c51a56905c17 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.260020 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add37b0-7431-4d9f-ae58-c51a56905c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.260294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add37b0-7431-4d9f-ae58-c51a56905c17 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.260980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add37b0-7431-4d9f-ae58-c51a56905c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.263085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add37b0-7431-4d9f-ae58-c51a56905c17 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.283307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-99ddf19b-57ae-4679-b3bf-6283faec85d8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:40.284547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-99ddf19b-57ae-4679-b3bf-6283faec85d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:40.292982 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1106/2257] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:40.301139 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b967f-35f3-4939-99f9-3802d344c517 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.301406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b967f-35f3-4939-99f9-3802d344c517 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.301673 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b967f-35f3-4939-99f9-3802d344c517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.320610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-304b967f-35f3-4939-99f9-3802d344c517 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:40.321898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-304b967f-35f3-4939-99f9-3802d344c517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:40.330316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1107/2258] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:40.334612 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b967f-35f3-4939-99f9-3802d344c517 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.343707 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b967f-35f3-4939-99f9-3802d344c517 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.348651 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eccaa-999a-497d-b6eb-224d93f00e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.349369 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eccaa-999a-497d-b6eb-224d93f00e61 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.349654 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eccaa-999a-497d-b6eb-224d93f00e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.349928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8eccaa-999a-497d-b6eb-224d93f00e61 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.350683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eccaa-999a-497d-b6eb-224d93f00e61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:40.350987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eccaa-999a-497d-b6eb-224d93f00e61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.352705 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8eccaa-999a-497d-b6eb-224d93f00e61 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.366529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1108/2259] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:57:40.370822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1152/2260] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:40 2022] POST /identity/v3/users => generated 295 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:40.371141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eccaa-999a-497d-b6eb-224d93f00e61 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.371547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add37b0-7431-4d9f-ae58-c51a56905c17 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.373432 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3add37b0-7431-4d9f-ae58-c51a56905c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:40.382214 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8eccaa-999a-497d-b6eb-224d93f00e61 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.386575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add37b0-7431-4d9f-ae58-c51a56905c17 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.387168 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b5ec-0084-4ebd-989b-8d90728859ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.387954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b5ec-0084-4ebd-989b-8d90728859ce admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.388234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b5ec-0084-4ebd-989b-8d90728859ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.388506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b5ec-0084-4ebd-989b-8d90728859ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.389213 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9b5ec-0084-4ebd-989b-8d90728859ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.391127 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9b5ec-0084-4ebd-989b-8d90728859ce admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.391334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a928359-3e3d-4510-a1f0-cbb4092a6376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.392012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a928359-3e3d-4510-a1f0-cbb4092a6376 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.392297 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a928359-3e3d-4510-a1f0-cbb4092a6376 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.392575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a928359-3e3d-4510-a1f0-cbb4092a6376 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.393334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a928359-3e3d-4510-a1f0-cbb4092a6376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.394934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a928359-3e3d-4510-a1f0-cbb4092a6376 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.408103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1153/2261] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:40.409349 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a928359-3e3d-4510-a1f0-cbb4092a6376 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.419160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a928359-3e3d-4510-a1f0-cbb4092a6376 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.423766 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3275c93-815f-4fd8-8b58-31aa9391bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.425236 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3275c93-815f-4fd8-8b58-31aa9391bdee admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.425519 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3275c93-815f-4fd8-8b58-31aa9391bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.425793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3275c93-815f-4fd8-8b58-31aa9391bdee admin admin] PATH_INFO: `/v3/projects/b61f684e9c4e45c6a0a4565440b06afb/users/1230af8126054acca23bf658156a4725/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.440918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3275c93-815f-4fd8-8b58-31aa9391bdee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61f684e9c4e45c6a0a4565440b06afb, user_id=1230af8126054acca23bf658156a4725, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.443618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3275c93-815f-4fd8-8b58-31aa9391bdee admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.494998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1109/2262] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:40 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:40.507765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b5ec-0084-4ebd-989b-8d90728859ce admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.573364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b5ec-0084-4ebd-989b-8d90728859ce admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.579608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1154/2263] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:40 2022] PUT /identity/v3/projects/b61f684e9c4e45c6a0a4565440b06afb/users/1230af8126054acca23bf658156a4725/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:40.583904 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3275c93-815f-4fd8-8b58-31aa9391bdee admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.634526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06e38e-8958-427b-ae06-21fb71d26aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.635122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06e38e-8958-427b-ae06-21fb71d26aab admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.635401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06e38e-8958-427b-ae06-21fb71d26aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.635674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06e38e-8958-427b-ae06-21fb71d26aab admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.636371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06e38e-8958-427b-ae06-21fb71d26aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.638337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06e38e-8958-427b-ae06-21fb71d26aab admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.654059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3275c93-815f-4fd8-8b58-31aa9391bdee admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.660938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfa9e6-b30f-446e-a2e5-4cc005beed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.662423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa9e6-b30f-446e-a2e5-4cc005beed13 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.662705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa9e6-b30f-446e-a2e5-4cc005beed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.663366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfa9e6-b30f-446e-a2e5-4cc005beed13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.664535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfa9e6-b30f-446e-a2e5-4cc005beed13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.666154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfa9e6-b30f-446e-a2e5-4cc005beed13 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.676937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1155/2264] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:40.681621 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfa9e6-b30f-446e-a2e5-4cc005beed13 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.692125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfa9e6-b30f-446e-a2e5-4cc005beed13 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.698012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2ddaa-99c9-4d9d-9f99-9607a1c14319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.698856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2ddaa-99c9-4d9d-9f99-9607a1c14319 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.699294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2ddaa-99c9-4d9d-9f99-9607a1c14319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.699626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2ddaa-99c9-4d9d-9f99-9607a1c14319 admin admin] PATH_INFO: `/v3/projects/b61f684e9c4e45c6a0a4565440b06afb/users/1230af8126054acca23bf658156a4725/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.701691 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2ddaa-99c9-4d9d-9f99-9607a1c14319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b61f684e9c4e45c6a0a4565440b06afb, user_id=1230af8126054acca23bf658156a4725, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.704438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2ddaa-99c9-4d9d-9f99-9607a1c14319 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.716000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1156/2265] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:40 2022] PUT /identity/v3/projects/b61f684e9c4e45c6a0a4565440b06afb/users/1230af8126054acca23bf658156a4725/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:40.726800 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8ae8-f3bd-43b5-9345-ce4efdd1ce2c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.727450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8ae8-f3bd-43b5-9345-ce4efdd1ce2c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.727450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e8ae8-f3bd-43b5-9345-ce4efdd1ce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.728977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1110/2266] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:40 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:40.732790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06e38e-8958-427b-ae06-21fb71d26aab admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.743877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06e38e-8958-427b-ae06-21fb71d26aab admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.757966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-db6e8ae8-f3bd-43b5-9345-ce4efdd1ce2c None None] MFA Rules not processed for user `1230af8126054acca23bf658156a4725`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:40.763149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-db6e8ae8-f3bd-43b5-9345-ce4efdd1ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:40.810643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d9baa-b35e-4521-8e97-093de54ad637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.812154 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d9baa-b35e-4521-8e97-093de54ad637 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.812672 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d9baa-b35e-4521-8e97-093de54ad637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.813116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d9baa-b35e-4521-8e97-093de54ad637 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.813859 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d9baa-b35e-4521-8e97-093de54ad637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.820244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d9baa-b35e-4521-8e97-093de54ad637 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.827647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1111/2267] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:40.834911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d9baa-b35e-4521-8e97-093de54ad637 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.836846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1157/2268] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:40.847905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d9baa-b35e-4521-8e97-093de54ad637 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.850068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e8ae8-f3bd-43b5-9345-ce4efdd1ce2c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.853382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77658025-0afc-46c6-856b-51c35269614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.854114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658025-0afc-46c6-856b-51c35269614c admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.854397 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658025-0afc-46c6-856b-51c35269614c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.854672 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658025-0afc-46c6-856b-51c35269614c admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.855405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77658025-0afc-46c6-856b-51c35269614c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.857024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77658025-0afc-46c6-856b-51c35269614c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.857749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-db6e8ae8-f3bd-43b5-9345-ce4efdd1ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:40.868789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1112/2269] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:57:40.872960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77658025-0afc-46c6-856b-51c35269614c admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:40.882683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77658025-0afc-46c6-856b-51c35269614c admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.887446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae027912-55d6-4349-ab96-ee7cdb69c2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.888243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae027912-55d6-4349-ab96-ee7cdb69c2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.888523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae027912-55d6-4349-ab96-ee7cdb69c2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.888813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae027912-55d6-4349-ab96-ee7cdb69c2a1 admin admin] PATH_INFO: `/v3/projects/fa17ec63a0cf4933a894a34a5c0fd3f6/users/73a2983ccddd4ccfbfeb509b2847462a/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.903618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae027912-55d6-4349-ab96-ee7cdb69c2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa17ec63a0cf4933a894a34a5c0fd3f6, user_id=73a2983ccddd4ccfbfeb509b2847462a, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.906382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae027912-55d6-4349-ab96-ee7cdb69c2a1 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.913128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e8ae8-f3bd-43b5-9345-ce4efdd1ce2c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:40.917207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888006b-fb95-4314-b780-80eb52de7003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:40.917850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888006b-fb95-4314-b780-80eb52de7003 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:40.918160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888006b-fb95-4314-b780-80eb52de7003 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:40.918427 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888006b-fb95-4314-b780-80eb52de7003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:40.920241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5888006b-fb95-4314-b780-80eb52de7003 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:40.979238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888006b-fb95-4314-b780-80eb52de7003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:40.980824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888006b-fb95-4314-b780-80eb52de7003 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:40.991094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1158/2270] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:57:41.024936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1113/2271] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:40 2022] PUT /identity/v3/projects/fa17ec63a0cf4933a894a34a5c0fd3f6/users/73a2983ccddd4ccfbfeb509b2847462a/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:41.035924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36064-c9a1-471d-b994-2d2b5d68dd7d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:41.036210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36064-c9a1-471d-b994-2d2b5d68dd7d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:41.036487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36064-c9a1-471d-b994-2d2b5d68dd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:41.070493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d6a36064-c9a1-471d-b994-2d2b5d68dd7d None None] MFA Rules not processed for user `73a2983ccddd4ccfbfeb509b2847462a`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:41.071336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d6a36064-c9a1-471d-b994-2d2b5d68dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:41.146516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1159/2272] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:41.151234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae027912-55d6-4349-ab96-ee7cdb69c2a1 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:41.233609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae027912-55d6-4349-ab96-ee7cdb69c2a1 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:41.239410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024fc36-5d95-4788-9870-0ca76f82cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:41.240000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024fc36-5d95-4788-9870-0ca76f82cdcc admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:41.240302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024fc36-5d95-4788-9870-0ca76f82cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:41.240610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024fc36-5d95-4788-9870-0ca76f82cdcc admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:41.241217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024fc36-5d95-4788-9870-0ca76f82cdcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:41.243407 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024fc36-5d95-4788-9870-0ca76f82cdcc admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:41.347394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1114/2273] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:41 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:41.352047 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36064-c9a1-471d-b994-2d2b5d68dd7d None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:41.363122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36064-c9a1-471d-b994-2d2b5d68dd7d None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:41.420011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34030d06-7993-4cef-8ded-f3f3b7597d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:41.420595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34030d06-7993-4cef-8ded-f3f3b7597d30 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:41.420875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34030d06-7993-4cef-8ded-f3f3b7597d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:41.421148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34030d06-7993-4cef-8ded-f3f3b7597d30 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:41.421856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34030d06-7993-4cef-8ded-f3f3b7597d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:41.423923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34030d06-7993-4cef-8ded-f3f3b7597d30 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:41.523365 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1160/2274] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:41 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:41.527075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024fc36-5d95-4788-9870-0ca76f82cdcc admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:41.537473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024fc36-5d95-4788-9870-0ca76f82cdcc admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:41.542242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269d46-a413-4f87-af08-eb00300e9f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:41.542988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269d46-a413-4f87-af08-eb00300e9f25 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:41.543265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269d46-a413-4f87-af08-eb00300e9f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:41.543555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269d46-a413-4f87-af08-eb00300e9f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:41.544305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8269d46-a413-4f87-af08-eb00300e9f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:41.545960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8269d46-a413-4f87-af08-eb00300e9f25 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:41.557271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1115/2275] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:41.561568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34030d06-7993-4cef-8ded-f3f3b7597d30 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:41.572220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34030d06-7993-4cef-8ded-f3f3b7597d30 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:41.576798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e91de-9ba8-419e-b0b1-e82a2377be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:41.577671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e91de-9ba8-419e-b0b1-e82a2377be01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:41.577959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e91de-9ba8-419e-b0b1-e82a2377be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:41.578262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e91de-9ba8-419e-b0b1-e82a2377be01 admin admin] PATH_INFO: `/v3/projects/038c640972264fec9ca80e7898c491e1/users/12747bc2307f4131825885348ba6b908/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:41.593310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e91de-9ba8-419e-b0b1-e82a2377be01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038c640972264fec9ca80e7898c491e1, user_id=12747bc2307f4131825885348ba6b908, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:41.596024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e91de-9ba8-419e-b0b1-e82a2377be01 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:41.719386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1161/2276] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:41 2022] PUT /identity/v3/projects/038c640972264fec9ca80e7898c491e1/users/12747bc2307f4131825885348ba6b908/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:41.728003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269d46-a413-4f87-af08-eb00300e9f25 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:41.740717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269d46-a413-4f87-af08-eb00300e9f25 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:41.809632 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4508fa-e9d0-468c-88b4-ba46ee2b81e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:41.810299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4508fa-e9d0-468c-88b4-ba46ee2b81e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:41.810583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4508fa-e9d0-468c-88b4-ba46ee2b81e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:41.810882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4508fa-e9d0-468c-88b4-ba46ee2b81e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:41.811733 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4508fa-e9d0-468c-88b4-ba46ee2b81e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:41.813397 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4508fa-e9d0-468c-88b4-ba46ee2b81e3 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:41.826023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1116/2277] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:41.829907 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e91de-9ba8-419e-b0b1-e82a2377be01 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:41.842132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e91de-9ba8-419e-b0b1-e82a2377be01 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:41.850270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1d6e-f08a-4237-bb31-975a5ba08296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:41.860226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1d6e-f08a-4237-bb31-975a5ba08296 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:41.860755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1d6e-f08a-4237-bb31-975a5ba08296 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:41.860897 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1d6e-f08a-4237-bb31-975a5ba08296 admin admin] PATH_INFO: `/v3/projects/038c640972264fec9ca80e7898c491e1/users/12747bc2307f4131825885348ba6b908/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:41.864587 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1d6e-f08a-4237-bb31-975a5ba08296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038c640972264fec9ca80e7898c491e1, user_id=12747bc2307f4131825885348ba6b908, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:41.871265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1d6e-f08a-4237-bb31-975a5ba08296 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:41.887917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1162/2278] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:41 2022] PUT /identity/v3/projects/038c640972264fec9ca80e7898c491e1/users/12747bc2307f4131825885348ba6b908/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:57:41.911765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971e56-5f2c-4d90-891d-1340ec4e54be None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:41.912102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971e56-5f2c-4d90-891d-1340ec4e54be None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:41.912335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971e56-5f2c-4d90-891d-1340ec4e54be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:41.943102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-c4971e56-5f2c-4d90-891d-1340ec4e54be None None] MFA Rules not processed for user `12747bc2307f4131825885348ba6b908`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:41.944300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c4971e56-5f2c-4d90-891d-1340ec4e54be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:42.024437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1117/2279] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:42.038550 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1d6e-f08a-4237-bb31-975a5ba08296 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:42.094156 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1d6e-f08a-4237-bb31-975a5ba08296 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:42.103457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e0e1b-9fd1-42f5-a7b5-8a74266a4400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:42.104120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0e1b-9fd1-42f5-a7b5-8a74266a4400 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:42.104478 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0e1b-9fd1-42f5-a7b5-8a74266a4400 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:42.104669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0e1b-9fd1-42f5-a7b5-8a74266a4400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:42.116460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e0e1b-9fd1-42f5-a7b5-8a74266a4400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:42.118192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e0e1b-9fd1-42f5-a7b5-8a74266a4400 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:42.130584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1163/2280] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:45.033813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971e56-5f2c-4d90-891d-1340ec4e54be None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:45.094811 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971e56-5f2c-4d90-891d-1340ec4e54be None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:45.099632 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:45.100493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:45.100773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:45.101044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] PATH_INFO: `/v3/users/73a2983ccddd4ccfbfeb509b2847462a` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:45.102257 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a2983ccddd4ccfbfeb509b2847462a)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:45.104179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:45.305114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a2983ccddd4ccfbfeb509b2847462a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:45.305854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a2983ccddd4ccfbfeb509b2847462a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:45.389372 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a2983ccddd4ccfbfeb509b2847462a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:45.397787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a2983ccddd4ccfbfeb509b2847462a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:45.410831 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a2983ccddd4ccfbfeb509b2847462a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:45.417083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1118/2281] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:45 2022] DELETE /identity/v3/users/73a2983ccddd4ccfbfeb509b2847462a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:45.436394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558dac-3525-4317-b361-584d3699ae86 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:45.437008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558dac-3525-4317-b361-584d3699ae86 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:45.437008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558dac-3525-4317-b361-584d3699ae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:45.458308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-af558dac-3525-4317-b361-584d3699ae86 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:45.459589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-af558dac-3525-4317-b361-584d3699ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:45.519769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1164/2282] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:45.529864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:45.534827 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:45.601945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630f75e-b1a8-4d4d-8d87-3a2cd11878e6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:45.605676 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0147f-2993-4972-b76b-03f7eab7c970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:45.606353 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0147f-2993-4972-b76b-03f7eab7c970 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:45.606632 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0147f-2993-4972-b76b-03f7eab7c970 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:45.606905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0147f-2993-4972-b76b-03f7eab7c970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:45.617217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0147f-2993-4972-b76b-03f7eab7c970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:45.618717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0147f-2993-4972-b76b-03f7eab7c970 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:45.628282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1119/2283] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:57:46.054470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af558dac-3525-4317-b361-584d3699ae86 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:46.056004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-af558dac-3525-4317-b361-584d3699ae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:46.071509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af558dac-3525-4317-b361-584d3699ae86 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:46.076546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:46.077405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:46.077681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:46.077949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] PATH_INFO: `/v3/projects/fa17ec63a0cf4933a894a34a5c0fd3f6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:46.081124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa17ec63a0cf4933a894a34a5c0fd3f6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:46.083150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:46.177358 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa17ec63a0cf4933a894a34a5c0fd3f6', 'request_id': 'req-2b5baa07-26c0-4b52-bcee-55f0fb174433'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:46.183360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa17ec63a0cf4933a894a34a5c0fd3f6', 'request_id': 'req-2b5baa07-26c0-4b52-bcee-55f0fb174433'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:46.246210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa17ec63a0cf4933a894a34a5c0fd3f6', 'request_id': 'req-2b5baa07-26c0-4b52-bcee-55f0fb174433'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:46.257183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] The token cache is being invalidate because project fa17ec63a0cf4933a894a34a5c0fd3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:46.257465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:46.258125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:46.259663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1165/2284] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:46 2022] DELETE /identity/v3/projects/fa17ec63a0cf4933a894a34a5c0fd3f6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:46.263708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0147f-2993-4972-b76b-03f7eab7c970 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:46.273526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0147f-2993-4972-b76b-03f7eab7c970 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:46.327535 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:46.328419 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:46.328693 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:46.328964 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] PATH_INFO: `/v3/users/12747bc2307f4131825885348ba6b908` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:46.330159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12747bc2307f4131825885348ba6b908)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:46.332225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:46.539534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12747bc2307f4131825885348ba6b908'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:46.540180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12747bc2307f4131825885348ba6b908'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:46.623494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12747bc2307f4131825885348ba6b908'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:46.634172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12747bc2307f4131825885348ba6b908'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:46.646907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a9d4fa7b-d04f-4249-b0d0-3bfccc00abb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12747bc2307f4131825885348ba6b908'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:46.653080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1120/2285] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:46 2022] DELETE /identity/v3/users/12747bc2307f4131825885348ba6b908 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:47.083246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:47.084685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:47.100532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5baa07-26c0-4b52-bcee-55f0fb174433 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:47.168940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:47.169799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:47.170096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:47.170363 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] PATH_INFO: `/v3/projects/038c640972264fec9ca80e7898c491e1` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:47.171529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=038c640972264fec9ca80e7898c491e1)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:47.173425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:47.275464 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038c640972264fec9ca80e7898c491e1', 'request_id': 'req-6a8ae686-e2bb-4779-945f-601e592c26ad'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:47.282797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038c640972264fec9ca80e7898c491e1', 'request_id': 'req-6a8ae686-e2bb-4779-945f-601e592c26ad'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:47.338149 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038c640972264fec9ca80e7898c491e1', 'request_id': 'req-6a8ae686-e2bb-4779-945f-601e592c26ad'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:47.350196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] The token cache is being invalidate because project 038c640972264fec9ca80e7898c491e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:47.350752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:47.351102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-6a8ae686-e2bb-4779-945f-601e592c26ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:47.352730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1166/2286] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:47 2022] DELETE /identity/v3/projects/038c640972264fec9ca80e7898c491e1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:47.357876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b870-8f79-444d-a935-dabe223d9558 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:47.358408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b870-8f79-444d-a935-dabe223d9558 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:47.358504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3b870-8f79-444d-a935-dabe223d9558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:47.376059 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-d9d3b870-8f79-444d-a935-dabe223d9558 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:47.377816 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d9d3b870-8f79-444d-a935-dabe223d9558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:47.434512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1121/2287] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:47.443288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bccde-fb29-4eb8-8045-15ce42a4336b None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:47.443567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bccde-fb29-4eb8-8045-15ce42a4336b None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:47.443841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bccde-fb29-4eb8-8045-15ce42a4336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:47.462317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-500bccde-fb29-4eb8-8045-15ce42a4336b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:47.463768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-500bccde-fb29-4eb8-8045-15ce42a4336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:47.471677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1167/2288] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:47.475975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b870-8f79-444d-a935-dabe223d9558 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:47.485547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3b870-8f79-444d-a935-dabe223d9558 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:47.490447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be8c04-e922-4fd8-8f95-0adbe08f6bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:47.491094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be8c04-e922-4fd8-8f95-0adbe08f6bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:47.491373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be8c04-e922-4fd8-8f95-0adbe08f6bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:47.491649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be8c04-e922-4fd8-8f95-0adbe08f6bc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:47.492402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be8c04-e922-4fd8-8f95-0adbe08f6bc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:47.492710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be8c04-e922-4fd8-8f95-0adbe08f6bc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:47.494337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be8c04-e922-4fd8-8f95-0adbe08f6bc7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:47.507378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1122/2289] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:47.511714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bccde-fb29-4eb8-8045-15ce42a4336b None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:47.521546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bccde-fb29-4eb8-8045-15ce42a4336b None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:47.526244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca8f15-7172-4b91-ae62-d63280c764ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:47.526838 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8f15-7172-4b91-ae62-d63280c764ac admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:47.527122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8f15-7172-4b91-ae62-d63280c764ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:47.527389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca8f15-7172-4b91-ae62-d63280c764ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:47.528077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca8f15-7172-4b91-ae62-d63280c764ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:47.529956 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca8f15-7172-4b91-ae62-d63280c764ac admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:47.624720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1168/2290] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:47 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:47.629714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be8c04-e922-4fd8-8f95-0adbe08f6bc7 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:47.639657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be8c04-e922-4fd8-8f95-0adbe08f6bc7 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:47.695773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36f7b4-8756-4e2e-b810-5f873bfd711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:47.696445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36f7b4-8756-4e2e-b810-5f873bfd711a admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:47.696726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36f7b4-8756-4e2e-b810-5f873bfd711a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:47.696998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36f7b4-8756-4e2e-b810-5f873bfd711a admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:47.697690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36f7b4-8756-4e2e-b810-5f873bfd711a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:47.699802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36f7b4-8756-4e2e-b810-5f873bfd711a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:47.784380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1123/2291] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:47 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:47.788396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca8f15-7172-4b91-ae62-d63280c764ac admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:47.798931 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca8f15-7172-4b91-ae62-d63280c764ac admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:47.805257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f09af-dd66-49d1-a479-94c28f072368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:47.805920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f09af-dd66-49d1-a479-94c28f072368 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:47.806235 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f09af-dd66-49d1-a479-94c28f072368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:47.806512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f09af-dd66-49d1-a479-94c28f072368 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:47.807220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f09af-dd66-49d1-a479-94c28f072368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:47.808797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f09af-dd66-49d1-a479-94c28f072368 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:47.823423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1169/2292] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:47.824230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36f7b4-8756-4e2e-b810-5f873bfd711a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:47.834018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36f7b4-8756-4e2e-b810-5f873bfd711a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:47.839193 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f15f0-78aa-4e27-88f1-6a2d0ff625a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:47.839876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f15f0-78aa-4e27-88f1-6a2d0ff625a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:47.840194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f15f0-78aa-4e27-88f1-6a2d0ff625a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:47.840416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f15f0-78aa-4e27-88f1-6a2d0ff625a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:47.841274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f15f0-78aa-4e27-88f1-6a2d0ff625a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:47.842897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f15f0-78aa-4e27-88f1-6a2d0ff625a6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:47.853433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1124/2293] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:47.857454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f09af-dd66-49d1-a479-94c28f072368 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:47.868110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f09af-dd66-49d1-a479-94c28f072368 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:47.872770 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ebb95-d0ac-4785-9823-2ced34c8b1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:47.876375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ebb95-d0ac-4785-9823-2ced34c8b1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:47.876375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ebb95-d0ac-4785-9823-2ced34c8b1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:47.876375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ebb95-d0ac-4785-9823-2ced34c8b1ec admin admin] PATH_INFO: `/v3/projects/9ec87a610af5441d8de7e84dc1ceb3c8/users/3a39dad7ff094cab98863a4760e09654/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:47.888568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ebb95-d0ac-4785-9823-2ced34c8b1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec87a610af5441d8de7e84dc1ceb3c8, user_id=3a39dad7ff094cab98863a4760e09654, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:47.891235 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ebb95-d0ac-4785-9823-2ced34c8b1ec admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:48.058613 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1170/2294] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:47 2022] PUT /identity/v3/projects/9ec87a610af5441d8de7e84dc1ceb3c8/users/3a39dad7ff094cab98863a4760e09654/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:48.072280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c42f6-df38-49b1-9f7c-2cc3c44f739c None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:48.072569 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c42f6-df38-49b1-9f7c-2cc3c44f739c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:48.072845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c42f6-df38-49b1-9f7c-2cc3c44f739c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:48.099493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f90c42f6-df38-49b1-9f7c-2cc3c44f739c None None] MFA Rules not processed for user `3a39dad7ff094cab98863a4760e09654`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:48.100708 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f90c42f6-df38-49b1-9f7c-2cc3c44f739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:48.168446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1125/2295] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:48.179027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ebb95-d0ac-4785-9823-2ced34c8b1ec admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:48.180737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7c2ebb95-d0ac-4785-9823-2ced34c8b1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:48.240890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ebb95-d0ac-4785-9823-2ced34c8b1ec admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:48.244557 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08e5e1-c4de-470b-a61c-8937a83797b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:48.245189 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08e5e1-c4de-470b-a61c-8937a83797b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:48.245465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08e5e1-c4de-470b-a61c-8937a83797b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:48.245733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08e5e1-c4de-470b-a61c-8937a83797b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:48.253796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08e5e1-c4de-470b-a61c-8937a83797b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:48.255236 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08e5e1-c4de-470b-a61c-8937a83797b2 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:48.263733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1171/2296] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:49.490080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c42f6-df38-49b1-9f7c-2cc3c44f739c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:49.491501 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f90c42f6-df38-49b1-9f7c-2cc3c44f739c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:49.503823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c42f6-df38-49b1-9f7c-2cc3c44f739c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:49.507412 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce168f-c56e-4088-bda2-996311b803d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:49.508041 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce168f-c56e-4088-bda2-996311b803d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:49.508322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce168f-c56e-4088-bda2-996311b803d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:49.508598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce168f-c56e-4088-bda2-996311b803d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:49.510340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-49ce168f-c56e-4088-bda2-996311b803d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:49.569188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce168f-c56e-4088-bda2-996311b803d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:49.570678 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce168f-c56e-4088-bda2-996311b803d5 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:49.579454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1126/2297] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:49.928347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08e5e1-c4de-470b-a61c-8937a83797b2 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:49.929850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-cf08e5e1-c4de-470b-a61c-8937a83797b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:49.995089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08e5e1-c4de-470b-a61c-8937a83797b2 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:50.001755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:50.001755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:50.001755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:50.001755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] PATH_INFO: `/v3/users/8145edc2e03c4afbb9f46e819931f642` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:50.003299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8145edc2e03c4afbb9f46e819931f642)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:50.005111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:50.221834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8145edc2e03c4afbb9f46e819931f642'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:50.229180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8145edc2e03c4afbb9f46e819931f642'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:50.298185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8145edc2e03c4afbb9f46e819931f642'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:50.310669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8145edc2e03c4afbb9f46e819931f642'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:50.311347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8145edc2e03c4afbb9f46e819931f642'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:50.317439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1172/2298] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:57:49 2022] DELETE /identity/v3/users/8145edc2e03c4afbb9f46e819931f642 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:50.321998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96868-ed21-47c0-a3a9-640500a8fc99 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:50.323485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96868-ed21-47c0-a3a9-640500a8fc99 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:50.323485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96868-ed21-47c0-a3a9-640500a8fc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:50.340329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-2de96868-ed21-47c0-a3a9-640500a8fc99 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:50.341523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2de96868-ed21-47c0-a3a9-640500a8fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:50.407051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1127/2299] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:50.419587 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:50.421637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:50.487684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e17b7-63eb-4a9e-bd4f-f1f74abce180 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:50.491307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf40cc-92e8-4d73-bbe6-fb0793471109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:50.492019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf40cc-92e8-4d73-bbe6-fb0793471109 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:50.492204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf40cc-92e8-4d73-bbe6-fb0793471109 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:50.492493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf40cc-92e8-4d73-bbe6-fb0793471109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:50.501276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf40cc-92e8-4d73-bbe6-fb0793471109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:50.503657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf40cc-92e8-4d73-bbe6-fb0793471109 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:50.513462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1173/2300] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:57:50.950790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de96868-ed21-47c0-a3a9-640500a8fc99 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:50.952191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2de96868-ed21-47c0-a3a9-640500a8fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:50.967114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de96868-ed21-47c0-a3a9-640500a8fc99 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:50.972123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:50.972993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:50.973276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:50.973555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] PATH_INFO: `/v3/projects/c6edac36081b47b9884557d4373fc3d4` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:50.974787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6edac36081b47b9884557d4373fc3d4)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:50.976772 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:51.128927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6edac36081b47b9884557d4373fc3d4', 'request_id': 'req-d75ca085-4981-4118-9d91-20637106591b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:51.135895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6edac36081b47b9884557d4373fc3d4', 'request_id': 'req-d75ca085-4981-4118-9d91-20637106591b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:51.142480 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6edac36081b47b9884557d4373fc3d4', 'request_id': 'req-d75ca085-4981-4118-9d91-20637106591b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:51.281087 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] The token cache is being invalidate because project c6edac36081b47b9884557d4373fc3d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:57:51.281439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:51.282308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:57:51.289500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1128/2301] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:57:50 2022] DELETE /identity/v3/projects/c6edac36081b47b9884557d4373fc3d4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:51.291131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a089e6-7d37-4fe9-bc2b-3f07d44f9057 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:51.291614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a089e6-7d37-4fe9-bc2b-3f07d44f9057 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:51.291687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a089e6-7d37-4fe9-bc2b-3f07d44f9057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:51.307260 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:51.309116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:51.311734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-a6a089e6-7d37-4fe9-bc2b-3f07d44f9057 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:51.313161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a6a089e6-7d37-4fe9-bc2b-3f07d44f9057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:51.376174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ca085-4981-4118-9d91-20637106591b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:51.380237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8982f-e1e6-4426-8605-c62bc0b36e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:51.380821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8982f-e1e6-4426-8605-c62bc0b36e51 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:51.381100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8982f-e1e6-4426-8605-c62bc0b36e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:51.381386 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8982f-e1e6-4426-8605-c62bc0b36e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:51.383217 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-50a8982f-e1e6-4426-8605-c62bc0b36e51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:51.392474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1174/2302] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:51.401194 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7de9d-cb45-47d1-99d0-6d43c4d801a3 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:51.401489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7de9d-cb45-47d1-99d0-6d43c4d801a3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:51.406812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7de9d-cb45-47d1-99d0-6d43c4d801a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:51.420478 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b1a7de9d-cb45-47d1-99d0-6d43c4d801a3 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:51.421735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b1a7de9d-cb45-47d1-99d0-6d43c4d801a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:51.430805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1175/2303] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:57:51.434890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7de9d-cb45-47d1-99d0-6d43c4d801a3 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:51.445150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7de9d-cb45-47d1-99d0-6d43c4d801a3 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:51.445486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8982f-e1e6-4426-8605-c62bc0b36e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:51.447239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8982f-e1e6-4426-8605-c62bc0b36e51 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:51.449858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5639b-a0ef-4766-8e97-0cca45373726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:51.450605 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5639b-a0ef-4766-8e97-0cca45373726 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:51.454078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5639b-a0ef-4766-8e97-0cca45373726 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:51.454078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5639b-a0ef-4766-8e97-0cca45373726 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:51.454078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5639b-a0ef-4766-8e97-0cca45373726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:57:51.454078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5639b-a0ef-4766-8e97-0cca45373726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:51.454078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5639b-a0ef-4766-8e97-0cca45373726 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:51.462046 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1129/2304] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:57:51.468946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1176/2305] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:57:51.474280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8982f-e1e6-4426-8605-c62bc0b36e51 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:51.484616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8982f-e1e6-4426-8605-c62bc0b36e51 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:51.489590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf475-cef5-4882-afb0-a7d25515fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:51.490544 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf475-cef5-4882-afb0-a7d25515fedc admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:51.490868 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf475-cef5-4882-afb0-a7d25515fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:51.492036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cf475-cef5-4882-afb0-a7d25515fedc admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:51.492036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cf475-cef5-4882-afb0-a7d25515fedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:51.493911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cf475-cef5-4882-afb0-a7d25515fedc admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:51.677834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1130/2306] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:57:51 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:57:51.681913 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5639b-a0ef-4766-8e97-0cca45373726 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:51.693154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5639b-a0ef-4766-8e97-0cca45373726 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:51.751840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b82ce3-f6f3-4a1e-a3e4-b0b5536a7e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:51.752758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b82ce3-f6f3-4a1e-a3e4-b0b5536a7e07 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:51.753450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b82ce3-f6f3-4a1e-a3e4-b0b5536a7e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:51.753730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b82ce3-f6f3-4a1e-a3e4-b0b5536a7e07 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:51.754531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b82ce3-f6f3-4a1e-a3e4-b0b5536a7e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:51.756502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b82ce3-f6f3-4a1e-a3e4-b0b5536a7e07 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:51.858554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1177/2307] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:57:51 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:57:51.865825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf475-cef5-4882-afb0-a7d25515fedc admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:51.876155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cf475-cef5-4882-afb0-a7d25515fedc admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:51.881648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c062703-29d5-4064-970e-81d5c04e8b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:51.882340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c062703-29d5-4064-970e-81d5c04e8b6b admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:51.882617 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c062703-29d5-4064-970e-81d5c04e8b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:51.882886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c062703-29d5-4064-970e-81d5c04e8b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:51.883604 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c062703-29d5-4064-970e-81d5c04e8b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:51.885215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c062703-29d5-4064-970e-81d5c04e8b6b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:51.896160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1131/2308] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:51.900284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b82ce3-f6f3-4a1e-a3e4-b0b5536a7e07 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:51.910724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b82ce3-f6f3-4a1e-a3e4-b0b5536a7e07 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:51.915273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeecced-2595-4e11-993c-5d7e2014319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:51.915916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeecced-2595-4e11-993c-5d7e2014319c admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:51.916193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeecced-2595-4e11-993c-5d7e2014319c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:51.916462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeecced-2595-4e11-993c-5d7e2014319c admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:51.917207 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeecced-2595-4e11-993c-5d7e2014319c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:51.918831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeecced-2595-4e11-993c-5d7e2014319c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:51.929430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1178/2309] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:57:51.932736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c062703-29d5-4064-970e-81d5c04e8b6b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:51.943266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c062703-29d5-4064-970e-81d5c04e8b6b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:51.947869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609778c-2aa8-44a7-b879-472b2c0eee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:51.948770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609778c-2aa8-44a7-b879-472b2c0eee5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:51.949049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609778c-2aa8-44a7-b879-472b2c0eee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:51.949314 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609778c-2aa8-44a7-b879-472b2c0eee5c admin admin] PATH_INFO: `/v3/projects/645aaf2aa32e48cb94ada50bed462c26/users/e45f306d55b3414bbc281e3372e0225c/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:51.964745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609778c-2aa8-44a7-b879-472b2c0eee5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=645aaf2aa32e48cb94ada50bed462c26, user_id=e45f306d55b3414bbc281e3372e0225c, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:51.967638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609778c-2aa8-44a7-b879-472b2c0eee5c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:52.041798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1132/2310] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:57:51 2022] PUT /identity/v3/projects/645aaf2aa32e48cb94ada50bed462c26/users/e45f306d55b3414bbc281e3372e0225c/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:57:52.052298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8a14-914f-4ddf-b2bc-8ee80fc3656e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:52.052586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8a14-914f-4ddf-b2bc-8ee80fc3656e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:52.052861 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb8a14-914f-4ddf-b2bc-8ee80fc3656e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:52.080998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-a0eb8a14-914f-4ddf-b2bc-8ee80fc3656e None None] MFA Rules not processed for user `e45f306d55b3414bbc281e3372e0225c`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:57:52.082305 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a0eb8a14-914f-4ddf-b2bc-8ee80fc3656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:52.142765 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1179/2311] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:57:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:57:52.154576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609778c-2aa8-44a7-b879-472b2c0eee5c admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:57:52.156242 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a609778c-2aa8-44a7-b879-472b2c0eee5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:57:52.211216 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609778c-2aa8-44a7-b879-472b2c0eee5c admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:57:52.215018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138670db-a080-4033-b217-4d63d267b2cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500eaf6aadff441ca1e535443e1d8c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:57:52.215646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138670db-a080-4033-b217-4d63d267b2cb service glance] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:57:52.215921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138670db-a080-4033-b217-4d63d267b2cb service glance] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:57:52.216218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138670db-a080-4033-b217-4d63d267b2cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:57:52.224301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138670db-a080-4033-b217-4d63d267b2cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:57:52.225717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138670db-a080-4033-b217-4d63d267b2cb service glance] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:57:52.234163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1133/2312] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:57:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:58:15.740694 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8a14-914f-4ddf-b2bc-8ee80fc3656e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:15.742189 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a0eb8a14-914f-4ddf-b2bc-8ee80fc3656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:15.873368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb8a14-914f-4ddf-b2bc-8ee80fc3656e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:15.878384 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:15.879371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:15.879626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:15.879890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] PATH_INFO: `/v3/users/e96c42827e39441ca5987ae129e449de` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:15.881090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96c42827e39441ca5987ae129e449de)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:15.883060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:16.111440 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96c42827e39441ca5987ae129e449de'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:16.119241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96c42827e39441ca5987ae129e449de'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:16.212774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96c42827e39441ca5987ae129e449de'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:16.226163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96c42827e39441ca5987ae129e449de'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:16.226937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96c42827e39441ca5987ae129e449de'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:16.232779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1180/2313] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:58:15 2022] DELETE /identity/v3/users/e96c42827e39441ca5987ae129e449de => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:16.237341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6db235-4729-4a8e-80c5-8e9d8f202e35 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:16.237822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6db235-4729-4a8e-80c5-8e9d8f202e35 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:16.238128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6db235-4729-4a8e-80c5-8e9d8f202e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:16.264786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-0c6db235-4729-4a8e-80c5-8e9d8f202e35 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:16.265905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0c6db235-4729-4a8e-80c5-8e9d8f202e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:16.338248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1134/2314] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:58:16.348612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:16.352093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:16.395491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6db235-4729-4a8e-80c5-8e9d8f202e35 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:16.396891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0c6db235-4729-4a8e-80c5-8e9d8f202e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:16.408692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6db235-4729-4a8e-80c5-8e9d8f202e35 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:16.413402 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:16.414288 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:16.414564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:16.414832 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] PATH_INFO: `/v3/users/15c1e6bcd5334f99b5a0e792510f4808` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:16.416029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c1e6bcd5334f99b5a0e792510f4808)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:16.418007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:16.473454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371b1a-72e3-42c0-99c4-48a516eb0574 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:16.477229 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4510b8-ec15-48d4-ba91-7fc6d3ab0716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:16.477909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4510b8-ec15-48d4-ba91-7fc6d3ab0716 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:16.478224 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4510b8-ec15-48d4-ba91-7fc6d3ab0716 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:16.478502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4510b8-ec15-48d4-ba91-7fc6d3ab0716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:16.488146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4510b8-ec15-48d4-ba91-7fc6d3ab0716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:16.489568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4510b8-ec15-48d4-ba91-7fc6d3ab0716 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:16.499320 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1181/2315] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:58:16.687921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c1e6bcd5334f99b5a0e792510f4808'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:16.688633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c1e6bcd5334f99b5a0e792510f4808'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:16.789478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c1e6bcd5334f99b5a0e792510f4808'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:16.796845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c1e6bcd5334f99b5a0e792510f4808'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:16.810663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c1e6bcd5334f99b5a0e792510f4808'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:16.818166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1135/2316] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:58:16 2022] DELETE /identity/v3/users/15c1e6bcd5334f99b5a0e792510f4808 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:58:16.822604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c8d86-a42c-4e44-b57b-4224dac51f09 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:16.823070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c8d86-a42c-4e44-b57b-4224dac51f09 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:16.823160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c8d86-a42c-4e44-b57b-4224dac51f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:16.839943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b50c8d86-a42c-4e44-b57b-4224dac51f09 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:16.841102 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b50c8d86-a42c-4e44-b57b-4224dac51f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:16.912853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1182/2317] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:58:16.922633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:16.925769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:16.994701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff89c0-bd42-4543-9e02-66660ea9ebca admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:16.998543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73482df-f17b-4258-88f5-cf4667c328da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:16.999268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73482df-f17b-4258-88f5-cf4667c328da service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:16.999593 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73482df-f17b-4258-88f5-cf4667c328da service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:16.999867 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73482df-f17b-4258-88f5-cf4667c328da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:17.009823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73482df-f17b-4258-88f5-cf4667c328da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:17.011392 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73482df-f17b-4258-88f5-cf4667c328da service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:17.022564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1136/2318] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:58:17.261263 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c8d86-a42c-4e44-b57b-4224dac51f09 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:17.265237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b50c8d86-a42c-4e44-b57b-4224dac51f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:17.294376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c8d86-a42c-4e44-b57b-4224dac51f09 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:17.315566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:17.317852 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:17.318305 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:17.318759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] PATH_INFO: `/v3/projects/1ccf2edff7f948eea02acc9bdf4fe456` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:17.322893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ccf2edff7f948eea02acc9bdf4fe456)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:17.322893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:17.454787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ccf2edff7f948eea02acc9bdf4fe456', 'request_id': 'req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:17.462948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ccf2edff7f948eea02acc9bdf4fe456', 'request_id': 'req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:17.623761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ccf2edff7f948eea02acc9bdf4fe456', 'request_id': 'req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:17.631681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73482df-f17b-4258-88f5-cf4667c328da service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:17.633092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b73482df-f17b-4258-88f5-cf4667c328da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:17.636562 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] The token cache is being invalidate because project 1ccf2edff7f948eea02acc9bdf4fe456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:58:17.637235 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:17.637497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-92fb868d-8c9a-43c1-8dd6-a3acd2b2d857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:17.639319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1183/2319] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:58:17 2022] DELETE /identity/v3/projects/1ccf2edff7f948eea02acc9bdf4fe456 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:17.644275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2390eb-d430-4255-b7a4-d6d38c9b970a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:17.644275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2390eb-d430-4255-b7a4-d6d38c9b970a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:17.644693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2390eb-d430-4255-b7a4-d6d38c9b970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:17.647447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73482df-f17b-4258-88f5-cf4667c328da service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:17.692923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ff2390eb-d430-4255-b7a4-d6d38c9b970a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:17.694503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ff2390eb-d430-4255-b7a4-d6d38c9b970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:17.720295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:17.721733 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:17.722949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:17.723465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] PATH_INFO: `/v3/projects/5b1a09dd6a734ed8bd2be3f884bb7de4` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:17.725258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1a09dd6a734ed8bd2be3f884bb7de4)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:17.728074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:17.778044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1184/2320] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:58:17.782629 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b6848-7961-4ac2-bbe1-672735faae7a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:17.782940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b6848-7961-4ac2-bbe1-672735faae7a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:17.783215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b6848-7961-4ac2-bbe1-672735faae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:17.803247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-446b6848-7961-4ac2-bbe1-672735faae7a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:17.805771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-446b6848-7961-4ac2-bbe1-672735faae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:17.812463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1185/2321] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:58:17.817906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b6848-7961-4ac2-bbe1-672735faae7a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:17.827347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b6848-7961-4ac2-bbe1-672735faae7a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:17.832191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28e34-a4f3-49b6-86ce-ea0ba40a1c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:17.832846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28e34-a4f3-49b6-86ce-ea0ba40a1c48 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:17.833123 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28e34-a4f3-49b6-86ce-ea0ba40a1c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:17.833430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28e34-a4f3-49b6-86ce-ea0ba40a1c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:17.834618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28e34-a4f3-49b6-86ce-ea0ba40a1c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:58:17.834618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28e34-a4f3-49b6-86ce-ea0ba40a1c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:17.836168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28e34-a4f3-49b6-86ce-ea0ba40a1c48 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:17.856363 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1186/2322] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:58:17.859525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28e34-a4f3-49b6-86ce-ea0ba40a1c48 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:17.861383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1a09dd6a734ed8bd2be3f884bb7de4', 'request_id': 'req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:17.868750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1a09dd6a734ed8bd2be3f884bb7de4', 'request_id': 'req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:17.870401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28e34-a4f3-49b6-86ce-ea0ba40a1c48 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:17.874495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1a09dd6a734ed8bd2be3f884bb7de4', 'request_id': 'req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:17.936462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5d6ff-0513-455c-a479-b6ce02a57d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:17.937176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5d6ff-0513-455c-a479-b6ce02a57d51 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:17.937951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5d6ff-0513-455c-a479-b6ce02a57d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:17.938266 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5d6ff-0513-455c-a479-b6ce02a57d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:17.939420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5d6ff-0513-455c-a479-b6ce02a57d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:17.942623 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5d6ff-0513-455c-a479-b6ce02a57d51 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:17.990091 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] The token cache is being invalidate because project 5b1a09dd6a734ed8bd2be3f884bb7de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:58:17.990639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:17.991365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:17.993234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1137/2323] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:58:17 2022] DELETE /identity/v3/projects/5b1a09dd6a734ed8bd2be3f884bb7de4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:58:17.996963 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:17.998524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:18.012324 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6da5f-73e1-4a86-b3eb-9994c78fe3dc admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:18.017086 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:18.017950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:18.018296 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:18.018568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] PATH_INFO: `/v3/users/fb703085327d497fa5adc65621b912ec` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:18.020415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb703085327d497fa5adc65621b912ec)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:18.022542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:18.059563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1187/2324] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:58:17 2022] POST /identity/v3/projects => generated 395 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:58:18.063611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5d6ff-0513-455c-a479-b6ce02a57d51 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:18.065293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-34d5d6ff-0513-455c-a479-b6ce02a57d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:18.132956 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5d6ff-0513-455c-a479-b6ce02a57d51 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:18.137793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0eb85-1a6a-4a37-9f12-11fae8fe1eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:18.139275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0eb85-1a6a-4a37-9f12-11fae8fe1eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:18.139275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0eb85-1a6a-4a37-9f12-11fae8fe1eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:18.139275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0eb85-1a6a-4a37-9f12-11fae8fe1eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:18.140159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0eb85-1a6a-4a37-9f12-11fae8fe1eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:18.142019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0eb85-1a6a-4a37-9f12-11fae8fe1eb7 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:18.262710 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1188/2325] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:58:18 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:58:18.266092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0eb85-1a6a-4a37-9f12-11fae8fe1eb7 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:18.277188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0eb85-1a6a-4a37-9f12-11fae8fe1eb7 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:18.277887 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb703085327d497fa5adc65621b912ec'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:18.278701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb703085327d497fa5adc65621b912ec'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:18.283689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f138f4-f86d-4cf4-aa45-5a6070f572e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:18.284575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f138f4-f86d-4cf4-aa45-5a6070f572e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:18.284986 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f138f4-f86d-4cf4-aa45-5a6070f572e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:18.285714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f138f4-f86d-4cf4-aa45-5a6070f572e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:18.286409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f138f4-f86d-4cf4-aa45-5a6070f572e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:18.288034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f138f4-f86d-4cf4-aa45-5a6070f572e3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:18.298724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1189/2326] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:58:18.303123 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f138f4-f86d-4cf4-aa45-5a6070f572e3 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:18.312854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f138f4-f86d-4cf4-aa45-5a6070f572e3 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:18.318395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a10e8-f87c-497a-a35b-a3e129d42410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:18.319052 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a10e8-f87c-497a-a35b-a3e129d42410 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:18.319330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a10e8-f87c-497a-a35b-a3e129d42410 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:18.319601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a10e8-f87c-497a-a35b-a3e129d42410 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:18.322028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a10e8-f87c-497a-a35b-a3e129d42410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:18.322028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a10e8-f87c-497a-a35b-a3e129d42410 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:18.331943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1190/2327] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:58:18.336143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a10e8-f87c-497a-a35b-a3e129d42410 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:18.346318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a10e8-f87c-497a-a35b-a3e129d42410 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:18.351697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c39274-e9ed-4fcb-9e1c-3e58a9a94762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:18.352657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c39274-e9ed-4fcb-9e1c-3e58a9a94762 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:18.352945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c39274-e9ed-4fcb-9e1c-3e58a9a94762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:18.353296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c39274-e9ed-4fcb-9e1c-3e58a9a94762 admin admin] PATH_INFO: `/v3/projects/f2b34d317aab4e40a28b490442fdf1b1/users/ef44db0deab244fc8510f5453c496ed5/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:18.366433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb703085327d497fa5adc65621b912ec'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:18.370315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c39274-e9ed-4fcb-9e1c-3e58a9a94762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b34d317aab4e40a28b490442fdf1b1, user_id=ef44db0deab244fc8510f5453c496ed5, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:18.373982 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c39274-e9ed-4fcb-9e1c-3e58a9a94762 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:18.375198 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb703085327d497fa5adc65621b912ec'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:18.391077 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e6a55002-0fac-43bb-a9dd-267f8e6eb8c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb703085327d497fa5adc65621b912ec'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:18.397343 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1138/2328] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:58:17 2022] DELETE /identity/v3/users/fb703085327d497fa5adc65621b912ec => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:58:18.457101 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1191/2329] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:58:18 2022] PUT /identity/v3/projects/f2b34d317aab4e40a28b490442fdf1b1/users/ef44db0deab244fc8510f5453c496ed5/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:58:18.467637 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af6b4-c15c-46a7-b5f1-e756c1b4bfaa None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:18.468161 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af6b4-c15c-46a7-b5f1-e756c1b4bfaa None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:18.468522 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af6b4-c15c-46a7-b5f1-e756c1b4bfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:18.497630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-5e6af6b4-c15c-46a7-b5f1-e756c1b4bfaa None None] MFA Rules not processed for user `ef44db0deab244fc8510f5453c496ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:18.498861 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5e6af6b4-c15c-46a7-b5f1-e756c1b4bfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:18.561417 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1139/2330] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:58:18.574455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c39274-e9ed-4fcb-9e1c-3e58a9a94762 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:18.576335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-47c39274-e9ed-4fcb-9e1c-3e58a9a94762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:18.633590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c39274-e9ed-4fcb-9e1c-3e58a9a94762 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:18.637962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fa308-5212-42cd-9ea5-4ac70e65a488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:18.638853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fa308-5212-42cd-9ea5-4ac70e65a488 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:18.639163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fa308-5212-42cd-9ea5-4ac70e65a488 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:18.639513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fa308-5212-42cd-9ea5-4ac70e65a488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:18.649736 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fa308-5212-42cd-9ea5-4ac70e65a488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:18.651141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129fa308-5212-42cd-9ea5-4ac70e65a488 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:18.661754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1192/2331] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:58:18.975796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6af6b4-c15c-46a7-b5f1-e756c1b4bfaa None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:18.977180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5e6af6b4-c15c-46a7-b5f1-e756c1b4bfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:19.063330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6af6b4-c15c-46a7-b5f1-e756c1b4bfaa None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:19.075153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:19.075153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:19.075153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:19.075153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] PATH_INFO: `/v3/projects/a91c1449934249af82746f72850ae539` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:19.076206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91c1449934249af82746f72850ae539)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:19.076206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:19.241504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91c1449934249af82746f72850ae539', 'request_id': 'req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:19.247414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91c1449934249af82746f72850ae539', 'request_id': 'req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:19.252785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91c1449934249af82746f72850ae539', 'request_id': 'req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:19.384020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] The token cache is being invalidate because project a91c1449934249af82746f72850ae539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:58:19.384305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:19.384962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:19.387139 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1140/2332] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:58:18 2022] DELETE /identity/v3/projects/a91c1449934249af82746f72850ae539 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:19.390541 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fa308-5212-42cd-9ea5-4ac70e65a488 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:19.404002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fa308-5212-42cd-9ea5-4ac70e65a488 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:19.482155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:19.483131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:19.483420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:19.483697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] PATH_INFO: `/v3/users/1230af8126054acca23bf658156a4725` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:19.486650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1230af8126054acca23bf658156a4725)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:19.488693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:19.781546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1230af8126054acca23bf658156a4725'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:19.789848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1230af8126054acca23bf658156a4725'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:19.880479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1230af8126054acca23bf658156a4725'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:19.892752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1230af8126054acca23bf658156a4725'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:19.893386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-17a7700b-3297-4fb4-b10a-2c07d14847e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1230af8126054acca23bf658156a4725'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:19.900093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1193/2333] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:58:19 2022] DELETE /identity/v3/users/1230af8126054acca23bf658156a4725 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:20.397016 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:20.398504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:20.414075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ca0ad-ca14-4e84-8cfc-3f83dbe0b460 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:20.478799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:20.479691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:20.480069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:20.480351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] PATH_INFO: `/v3/projects/b61f684e9c4e45c6a0a4565440b06afb` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:20.481635 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b61f684e9c4e45c6a0a4565440b06afb)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:20.483666 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:20.619147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b61f684e9c4e45c6a0a4565440b06afb', 'request_id': 'req-f6d96506-92a5-4840-9c3e-d1b94631091b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:20.625309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b61f684e9c4e45c6a0a4565440b06afb', 'request_id': 'req-f6d96506-92a5-4840-9c3e-d1b94631091b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:20.632009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b61f684e9c4e45c6a0a4565440b06afb', 'request_id': 'req-f6d96506-92a5-4840-9c3e-d1b94631091b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:20.719069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] The token cache is being invalidate because project b61f684e9c4e45c6a0a4565440b06afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:58:20.719359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:20.719974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f6d96506-92a5-4840-9c3e-d1b94631091b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:20.721526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1141/2334] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:58:20 2022] DELETE /identity/v3/projects/b61f684e9c4e45c6a0a4565440b06afb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:20.727089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57815a-31f9-4c02-9319-439f102023ad None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:20.727566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57815a-31f9-4c02-9319-439f102023ad None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:20.727655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57815a-31f9-4c02-9319-439f102023ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:20.746461 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-fe57815a-31f9-4c02-9319-439f102023ad None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:20.747663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fe57815a-31f9-4c02-9319-439f102023ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:20.818117 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1194/2335] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:58:20.819849 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f1482-2dd4-4bbe-a096-fc84bb2c1e35 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:20.820135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f1482-2dd4-4bbe-a096-fc84bb2c1e35 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:20.820411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f1482-2dd4-4bbe-a096-fc84bb2c1e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:20.839892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-5c6f1482-2dd4-4bbe-a096-fc84bb2c1e35 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:20.841098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5c6f1482-2dd4-4bbe-a096-fc84bb2c1e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:20.853036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1142/2336] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:58:20.854481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57815a-31f9-4c02-9319-439f102023ad None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:20.865134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57815a-31f9-4c02-9319-439f102023ad None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:20.869980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0fe80-7f46-4b77-9017-f2ee32047ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:20.871631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0fe80-7f46-4b77-9017-f2ee32047ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:20.871631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0fe80-7f46-4b77-9017-f2ee32047ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:20.871631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0fe80-7f46-4b77-9017-f2ee32047ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:20.872070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0fe80-7f46-4b77-9017-f2ee32047ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:58:20.872418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0fe80-7f46-4b77-9017-f2ee32047ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:20.874075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0fe80-7f46-4b77-9017-f2ee32047ab8 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:20.885749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1195/2337] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:58:20.890281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f1482-2dd4-4bbe-a096-fc84bb2c1e35 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:20.902977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f1482-2dd4-4bbe-a096-fc84bb2c1e35 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:20.907971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f7c89-a6a1-4346-a214-5992f86ba681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:20.908732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7c89-a6a1-4346-a214-5992f86ba681 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:20.909083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7c89-a6a1-4346-a214-5992f86ba681 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:20.910272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7c89-a6a1-4346-a214-5992f86ba681 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:20.911239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f7c89-a6a1-4346-a214-5992f86ba681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:20.913159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f7c89-a6a1-4346-a214-5992f86ba681 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:21.048809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1143/2338] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:58:20 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:58:21.053642 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0fe80-7f46-4b77-9017-f2ee32047ab8 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:21.063594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0fe80-7f46-4b77-9017-f2ee32047ab8 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:21.118215 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515580a2-a3b2-4412-9669-0941f96a1f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:21.118908 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515580a2-a3b2-4412-9669-0941f96a1f87 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:21.119192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515580a2-a3b2-4412-9669-0941f96a1f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:21.119468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515580a2-a3b2-4412-9669-0941f96a1f87 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:21.120152 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515580a2-a3b2-4412-9669-0941f96a1f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:21.122085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515580a2-a3b2-4412-9669-0941f96a1f87 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:21.241425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1196/2339] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:58:21 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:58:21.247186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f7c89-a6a1-4346-a214-5992f86ba681 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:21.257447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f7c89-a6a1-4346-a214-5992f86ba681 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:21.261947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28190078-c0ad-4b74-b30c-8e395043307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:21.262637 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190078-c0ad-4b74-b30c-8e395043307d admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:21.262916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190078-c0ad-4b74-b30c-8e395043307d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:21.263188 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28190078-c0ad-4b74-b30c-8e395043307d admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:21.263910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28190078-c0ad-4b74-b30c-8e395043307d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:21.265490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28190078-c0ad-4b74-b30c-8e395043307d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:21.276620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1144/2340] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:58:21.280411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515580a2-a3b2-4412-9669-0941f96a1f87 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:21.291200 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515580a2-a3b2-4412-9669-0941f96a1f87 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:21.296087 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6d894-b7de-457f-9d79-05a2500940e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:21.296742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d894-b7de-457f-9d79-05a2500940e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:21.297024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d894-b7de-457f-9d79-05a2500940e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:21.297704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d894-b7de-457f-9d79-05a2500940e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:21.298194 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6d894-b7de-457f-9d79-05a2500940e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:21.300279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6d894-b7de-457f-9d79-05a2500940e2 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:21.310031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1197/2341] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:58:21.314135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28190078-c0ad-4b74-b30c-8e395043307d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:21.325325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28190078-c0ad-4b74-b30c-8e395043307d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:21.330148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763ed47-0297-4209-b235-f7933a26afe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:21.331027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763ed47-0297-4209-b235-f7933a26afe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:21.331309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763ed47-0297-4209-b235-f7933a26afe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:21.331586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763ed47-0297-4209-b235-f7933a26afe6 admin admin] PATH_INFO: `/v3/projects/9495f53c7aa6421389bc740be62cc154/users/ee96cb5781e2412a91bfd0ce020ece9c/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:21.348892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763ed47-0297-4209-b235-f7933a26afe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9495f53c7aa6421389bc740be62cc154, user_id=ee96cb5781e2412a91bfd0ce020ece9c, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:21.352053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763ed47-0297-4209-b235-f7933a26afe6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:21.450948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1145/2342] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:58:21 2022] PUT /identity/v3/projects/9495f53c7aa6421389bc740be62cc154/users/ee96cb5781e2412a91bfd0ce020ece9c/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:21.453195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f6e3-d5cb-4735-ab6d-2cf204cb0560 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:21.453491 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f6e3-d5cb-4735-ab6d-2cf204cb0560 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:21.453771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f6e3-d5cb-4735-ab6d-2cf204cb0560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:21.494128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-24b3f6e3-d5cb-4735-ab6d-2cf204cb0560 None None] MFA Rules not processed for user `ee96cb5781e2412a91bfd0ce020ece9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:21.494128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-24b3f6e3-d5cb-4735-ab6d-2cf204cb0560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:21.555563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1198/2343] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:58:21.567790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763ed47-0297-4209-b235-f7933a26afe6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:21.569480 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5763ed47-0297-4209-b235-f7933a26afe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:21.628021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763ed47-0297-4209-b235-f7933a26afe6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:21.632276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2c70b-8d6d-481a-871f-1d612238fc3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:21.632925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2c70b-8d6d-481a-871f-1d612238fc3a service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:21.633206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2c70b-8d6d-481a-871f-1d612238fc3a service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:21.633520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2c70b-8d6d-481a-871f-1d612238fc3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:21.641798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2c70b-8d6d-481a-871f-1d612238fc3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:21.643305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2c70b-8d6d-481a-871f-1d612238fc3a service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:21.652682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1146/2344] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:58:39.442524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f6e3-d5cb-4735-ab6d-2cf204cb0560 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:39.509160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3f6e3-d5cb-4735-ab6d-2cf204cb0560 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:39.513851 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:39.514753 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:39.515029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:39.515300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] PATH_INFO: `/v3/users/ee96cb5781e2412a91bfd0ce020ece9c` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:39.516489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee96cb5781e2412a91bfd0ce020ece9c)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:39.518444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:39.739347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2c70b-8d6d-481a-871f-1d612238fc3a service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:39.740773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-90c2c70b-8d6d-481a-871f-1d612238fc3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:39.755055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2c70b-8d6d-481a-871f-1d612238fc3a service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:39.761082 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:39.761945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:39.762295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:39.762623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] PATH_INFO: `/v3/users/ef44db0deab244fc8510f5453c496ed5` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:39.763821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef44db0deab244fc8510f5453c496ed5)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:39.765900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:39.841720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee96cb5781e2412a91bfd0ce020ece9c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:39.850319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee96cb5781e2412a91bfd0ce020ece9c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:39.938900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee96cb5781e2412a91bfd0ce020ece9c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:39.954262 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee96cb5781e2412a91bfd0ce020ece9c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:39.954980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f52b8d9b-e422-4f73-b281-aa712c64bb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee96cb5781e2412a91bfd0ce020ece9c'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:39.961056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1199/2345] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:58:39 2022] DELETE /identity/v3/users/ee96cb5781e2412a91bfd0ce020ece9c => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:39.966518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee04ee-e4c0-4801-b04a-d8d8fc77d3f1 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:39.966801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee04ee-e4c0-4801-b04a-d8d8fc77d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:39.967097 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee04ee-e4c0-4801-b04a-d8d8fc77d3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:39.988987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-a2ee04ee-e4c0-4801-b04a-d8d8fc77d3f1 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:39.990157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a2ee04ee-e4c0-4801-b04a-d8d8fc77d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:40.038345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef44db0deab244fc8510f5453c496ed5'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:40.038985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef44db0deab244fc8510f5453c496ed5'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:40.047712 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1200/2346] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:58:40.057412 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee04ee-e4c0-4801-b04a-d8d8fc77d3f1 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:40.058793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a2ee04ee-e4c0-4801-b04a-d8d8fc77d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:40.116759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee04ee-e4c0-4801-b04a-d8d8fc77d3f1 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:40.120546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942e806-387f-4505-876c-1bb3a20afd24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:40.121191 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e806-387f-4505-876c-1bb3a20afd24 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:40.121469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e806-387f-4505-876c-1bb3a20afd24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:40.121742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e806-387f-4505-876c-1bb3a20afd24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:40.130816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942e806-387f-4505-876c-1bb3a20afd24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:40.132640 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942e806-387f-4505-876c-1bb3a20afd24 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:40.143573 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1201/2347] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:58:40.155057 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef44db0deab244fc8510f5453c496ed5'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:40.162897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef44db0deab244fc8510f5453c496ed5'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:40.175619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef44db0deab244fc8510f5453c496ed5'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:40.181628 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1147/2348] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:58:39 2022] DELETE /identity/v3/users/ef44db0deab244fc8510f5453c496ed5 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:58:40.186692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead4c82-27a8-4511-8d96-f2e6d6859371 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:40.188146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead4c82-27a8-4511-8d96-f2e6d6859371 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:40.188146 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead4c82-27a8-4511-8d96-f2e6d6859371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:40.207715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2ead4c82-27a8-4511-8d96-f2e6d6859371 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:40.208950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2ead4c82-27a8-4511-8d96-f2e6d6859371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:40.270477 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1202/2349] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:58:40.281745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:40.283182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:40.341910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101d1bf-d9fe-4b16-9161-a1194e974c20 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:40.345695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432547d4-255a-4ba8-86d0-a202b46345d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:40.346390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432547d4-255a-4ba8-86d0-a202b46345d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:40.346724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432547d4-255a-4ba8-86d0-a202b46345d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:40.347000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432547d4-255a-4ba8-86d0-a202b46345d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:40.356418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432547d4-255a-4ba8-86d0-a202b46345d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:40.357857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432547d4-255a-4ba8-86d0-a202b46345d5 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:40.368023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1148/2350] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:58:40.710035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead4c82-27a8-4511-8d96-f2e6d6859371 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:40.711501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2ead4c82-27a8-4511-8d96-f2e6d6859371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:40.731298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead4c82-27a8-4511-8d96-f2e6d6859371 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:40.732506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:40.734037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:40.734037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:40.734423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] PATH_INFO: `/v3/projects/9495f53c7aa6421389bc740be62cc154` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:40.735772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9495f53c7aa6421389bc740be62cc154)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:40.738204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:40.882542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9495f53c7aa6421389bc740be62cc154', 'request_id': 'req-ab86f837-c848-4f6f-b3df-c9f80f6ad828'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:40.882542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9495f53c7aa6421389bc740be62cc154', 'request_id': 'req-ab86f837-c848-4f6f-b3df-c9f80f6ad828'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:40.909029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432547d4-255a-4ba8-86d0-a202b46345d5 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:40.911433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-432547d4-255a-4ba8-86d0-a202b46345d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:40.926197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432547d4-255a-4ba8-86d0-a202b46345d5 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:40.986365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:40.987254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:40.987559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:40.987837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] PATH_INFO: `/v3/projects/f2b34d317aab4e40a28b490442fdf1b1` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:40.989135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b34d317aab4e40a28b490442fdf1b1)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:40.991015 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:40.999035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9495f53c7aa6421389bc740be62cc154', 'request_id': 'req-ab86f837-c848-4f6f-b3df-c9f80f6ad828'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:41.010923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] The token cache is being invalidate because project 9495f53c7aa6421389bc740be62cc154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:58:41.011223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:41.012035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:41.013951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1203/2351] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:58:40 2022] DELETE /identity/v3/projects/9495f53c7aa6421389bc740be62cc154 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:41.109396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b34d317aab4e40a28b490442fdf1b1', 'request_id': 'req-78b42db2-9f2d-4992-81aa-452167e9b36e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:41.117138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b34d317aab4e40a28b490442fdf1b1', 'request_id': 'req-78b42db2-9f2d-4992-81aa-452167e9b36e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:41.126034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b34d317aab4e40a28b490442fdf1b1', 'request_id': 'req-78b42db2-9f2d-4992-81aa-452167e9b36e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:41.223155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] The token cache is being invalidate because project f2b34d317aab4e40a28b490442fdf1b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:58:41.223461 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:41.224170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-78b42db2-9f2d-4992-81aa-452167e9b36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:41.225968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1149/2352] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:58:40 2022] DELETE /identity/v3/projects/f2b34d317aab4e40a28b490442fdf1b1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:58:43.882307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:43.883716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:43.896868 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86f837-c848-4f6f-b3df-c9f80f6ad828 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:43.950594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:43.951464 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:43.951744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:43.952016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] PATH_INFO: `/v3/users/3a39dad7ff094cab98863a4760e09654` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:43.953185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a39dad7ff094cab98863a4760e09654)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:43.955112 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:44.160458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a39dad7ff094cab98863a4760e09654'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:44.167222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a39dad7ff094cab98863a4760e09654'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:44.262228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a39dad7ff094cab98863a4760e09654'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:44.274400 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a39dad7ff094cab98863a4760e09654'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:44.274998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a39dad7ff094cab98863a4760e09654'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:44.281044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1204/2353] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:58:43 2022] DELETE /identity/v3/users/3a39dad7ff094cab98863a4760e09654 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:44.285792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e026-abcc-4d23-900e-e928231d295a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:44.286316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e026-abcc-4d23-900e-e928231d295a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:44.286534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e026-abcc-4d23-900e-e928231d295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:44.304218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a8a1e026-abcc-4d23-900e-e928231d295a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:44.305395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a8a1e026-abcc-4d23-900e-e928231d295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:44.361929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1150/2354] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:58:44.372354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:44.373771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:44.431108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd459a93-af3e-424f-9e12-33362b15b2cf admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:44.435364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7651fe-acd9-493b-9d16-95a05640ee45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:44.435997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7651fe-acd9-493b-9d16-95a05640ee45 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:44.436275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7651fe-acd9-493b-9d16-95a05640ee45 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:44.436545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7651fe-acd9-493b-9d16-95a05640ee45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:44.445328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7651fe-acd9-493b-9d16-95a05640ee45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:44.446772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7651fe-acd9-493b-9d16-95a05640ee45 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:44.456619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1205/2355] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:58:44.800505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1e026-abcc-4d23-900e-e928231d295a None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:44.802225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a8a1e026-abcc-4d23-900e-e928231d295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:44.814493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1e026-abcc-4d23-900e-e928231d295a None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:44.819138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:44.819999 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:44.820271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:44.820538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] PATH_INFO: `/v3/users/584054d788c0404ba6275c27888c7ca4` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:44.821714 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=584054d788c0404ba6275c27888c7ca4)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:44.823892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:44.871157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7651fe-acd9-493b-9d16-95a05640ee45 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:44.872671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2c7651fe-acd9-493b-9d16-95a05640ee45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:44.885658 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7651fe-acd9-493b-9d16-95a05640ee45 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:44.890634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:44.891485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:44.891769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:44.892045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] PATH_INFO: `/v3/projects/9ec87a610af5441d8de7e84dc1ceb3c8` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:44.893240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec87a610af5441d8de7e84dc1ceb3c8)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:44.898579 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:45.094513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec87a610af5441d8de7e84dc1ceb3c8', 'request_id': 'req-1cebe984-63a3-418d-8c16-c3887ab2623e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.094980 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584054d788c0404ba6275c27888c7ca4'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.095631 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584054d788c0404ba6275c27888c7ca4'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.100696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec87a610af5441d8de7e84dc1ceb3c8', 'request_id': 'req-1cebe984-63a3-418d-8c16-c3887ab2623e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.199199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584054d788c0404ba6275c27888c7ca4'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.206208 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584054d788c0404ba6275c27888c7ca4'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.218312 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-55f073c6-12ee-44b8-91eb-18f1655d3c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584054d788c0404ba6275c27888c7ca4'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.224022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1151/2356] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:58:44 2022] DELETE /identity/v3/users/584054d788c0404ba6275c27888c7ca4 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:45.228394 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9990a88-70ef-43b9-a5de-71eca82e9b8f None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.229401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9990a88-70ef-43b9-a5de-71eca82e9b8f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.229748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9990a88-70ef-43b9-a5de-71eca82e9b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.246409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a9990a88-70ef-43b9-a5de-71eca82e9b8f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:45.247586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a9990a88-70ef-43b9-a5de-71eca82e9b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:45.284361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec87a610af5441d8de7e84dc1ceb3c8', 'request_id': 'req-1cebe984-63a3-418d-8c16-c3887ab2623e'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.295627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] The token cache is being invalidate because project 9ec87a610af5441d8de7e84dc1ceb3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:58:45.295906 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.296530 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cebe984-63a3-418d-8c16-c3887ab2623e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.298127 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1206/2357] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:58:44 2022] DELETE /identity/v3/projects/9ec87a610af5441d8de7e84dc1ceb3c8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:45.302923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f556-278c-40ad-9142-caca755b0e62 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.303204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f556-278c-40ad-9142-caca755b0e62 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.303475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f556-278c-40ad-9142-caca755b0e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.306639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1152/2358] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:58:45.313407 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9990a88-70ef-43b9-a5de-71eca82e9b8f None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:45.314779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a9990a88-70ef-43b9-a5de-71eca82e9b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:45.331570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-92f1f556-278c-40ad-9142-caca755b0e62 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:45.332744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-92f1f556-278c-40ad-9142-caca755b0e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:45.341709 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1207/2359] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:58:45.349025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2d4c7-1715-4533-8383-5ff8b6321d17 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.349310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2d4c7-1715-4533-8383-5ff8b6321d17 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.349581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2d4c7-1715-4533-8383-5ff8b6321d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.366902 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d0a2d4c7-1715-4533-8383-5ff8b6321d17 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:45.368069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d0a2d4c7-1715-4533-8383-5ff8b6321d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:45.369638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9990a88-70ef-43b9-a5de-71eca82e9b8f None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:45.373264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b225be1-9566-4210-af13-22bda8b3ff02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:45.373934 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b225be1-9566-4210-af13-22bda8b3ff02 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.374258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b225be1-9566-4210-af13-22bda8b3ff02 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.374533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b225be1-9566-4210-af13-22bda8b3ff02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.379040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1208/2360] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:58:45.380316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2d4c7-1715-4533-8383-5ff8b6321d17 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:45.387863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b225be1-9566-4210-af13-22bda8b3ff02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:45.389311 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b225be1-9566-4210-af13-22bda8b3ff02 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:45.393090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2d4c7-1715-4533-8383-5ff8b6321d17 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:45.394490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82492157-e034-4cb0-837f-1e920c8383f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:45.395126 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82492157-e034-4cb0-837f-1e920c8383f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.395409 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82492157-e034-4cb0-837f-1e920c8383f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.395682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82492157-e034-4cb0-837f-1e920c8383f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.396395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82492157-e034-4cb0-837f-1e920c8383f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:58:45.396698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82492157-e034-4cb0-837f-1e920c8383f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:45.398315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82492157-e034-4cb0-837f-1e920c8383f2 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:45.398681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1153/2361] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:58:45.411060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1209/2362] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:58:45.415263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b225be1-9566-4210-af13-22bda8b3ff02 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:45.425403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b225be1-9566-4210-af13-22bda8b3ff02 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:45.430172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefd494-8cba-4425-afdf-a974b762c6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:45.430840 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefd494-8cba-4425-afdf-a974b762c6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.431143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefd494-8cba-4425-afdf-a974b762c6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.431429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefd494-8cba-4425-afdf-a974b762c6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.432199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefd494-8cba-4425-afdf-a974b762c6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:45.434231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefd494-8cba-4425-afdf-a974b762c6d4 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:45.532301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1154/2363] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:58:45 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:58:45.535056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82492157-e034-4cb0-837f-1e920c8383f2 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:45.545299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82492157-e034-4cb0-837f-1e920c8383f2 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:45.603067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58854d-c2f4-4cd6-ba51-a68e8935a893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:45.604576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58854d-c2f4-4cd6-ba51-a68e8935a893 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.605169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58854d-c2f4-4cd6-ba51-a68e8935a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.605498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58854d-c2f4-4cd6-ba51-a68e8935a893 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.606264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58854d-c2f4-4cd6-ba51-a68e8935a893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:45.608202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58854d-c2f4-4cd6-ba51-a68e8935a893 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:45.692371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1210/2364] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:58:45 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:58:45.696463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefd494-8cba-4425-afdf-a974b762c6d4 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:45.706615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefd494-8cba-4425-afdf-a974b762c6d4 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:45.711899 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c50f7-24f5-47c9-9150-4c7aad432ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:45.712265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c50f7-24f5-47c9-9150-4c7aad432ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.712541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c50f7-24f5-47c9-9150-4c7aad432ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.712810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c50f7-24f5-47c9-9150-4c7aad432ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.714200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c50f7-24f5-47c9-9150-4c7aad432ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:45.715980 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c50f7-24f5-47c9-9150-4c7aad432ec3 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:45.726567 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1155/2365] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:58:45.731596 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58854d-c2f4-4cd6-ba51-a68e8935a893 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:45.741485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58854d-c2f4-4cd6-ba51-a68e8935a893 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:45.746209 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b4ac8-b224-4f0c-97c1-686845083703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:45.749932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b4ac8-b224-4f0c-97c1-686845083703 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.749932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b4ac8-b224-4f0c-97c1-686845083703 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.749932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b4ac8-b224-4f0c-97c1-686845083703 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.749932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b4ac8-b224-4f0c-97c1-686845083703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:45.749932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b4ac8-b224-4f0c-97c1-686845083703 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:45.759655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1211/2366] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:58:45.763585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c50f7-24f5-47c9-9150-4c7aad432ec3 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:45.773305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c50f7-24f5-47c9-9150-4c7aad432ec3 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:45.783891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769e61-22b7-4838-ac49-e45fa915b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:45.784966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769e61-22b7-4838-ac49-e45fa915b104 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.785245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769e61-22b7-4838-ac49-e45fa915b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.785520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769e61-22b7-4838-ac49-e45fa915b104 admin admin] PATH_INFO: `/v3/projects/37afd0d48df643ed91fab2520770c09b/users/a87435282fe84a7c924afe4e2dc1731b/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.802585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769e61-22b7-4838-ac49-e45fa915b104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37afd0d48df643ed91fab2520770c09b, user_id=a87435282fe84a7c924afe4e2dc1731b, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:45.805604 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769e61-22b7-4838-ac49-e45fa915b104 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:45.808654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b4ac8-b224-4f0c-97c1-686845083703 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:45.810586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-544b4ac8-b224-4f0c-97c1-686845083703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:45.835228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b4ac8-b224-4f0c-97c1-686845083703 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:45.842193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:45.843061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.843350 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.843685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] PATH_INFO: `/v3/projects/5c6353e349e848ea94e626778af4f42e` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.845088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6353e349e848ea94e626778af4f42e)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:45.847281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:45.892425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1156/2367] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:58:45 2022] PUT /identity/v3/projects/37afd0d48df643ed91fab2520770c09b/users/a87435282fe84a7c924afe4e2dc1731b/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:45.902983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27494215-a1c6-4c79-9f23-2d8e8fa6a4fa None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:45.903265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27494215-a1c6-4c79-9f23-2d8e8fa6a4fa None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:45.903539 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27494215-a1c6-4c79-9f23-2d8e8fa6a4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:45.929143 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-27494215-a1c6-4c79-9f23-2d8e8fa6a4fa None None] MFA Rules not processed for user `a87435282fe84a7c924afe4e2dc1731b`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:45.930367 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-27494215-a1c6-4c79-9f23-2d8e8fa6a4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:45.990591 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6353e349e848ea94e626778af4f42e', 'request_id': 'req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.994762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1157/2368] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:58:45.997643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6353e349e848ea94e626778af4f42e', 'request_id': 'req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:45.999830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27494215-a1c6-4c79-9f23-2d8e8fa6a4fa None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.061780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27494215-a1c6-4c79-9f23-2d8e8fa6a4fa None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.074483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6353e349e848ea94e626778af4f42e', 'request_id': 'req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:46.085348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] The token cache is being invalidate because project 5c6353e349e848ea94e626778af4f42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:58:46.085636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:46.086325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d03be817-66b6-4e5f-b2f7-d2a6bc85b035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:58:46.088829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1212/2369] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:58:45 2022] DELETE /identity/v3/projects/5c6353e349e848ea94e626778af4f42e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:46.093593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e2f0-175e-4f4a-8ce6-3efef3cf4996 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.093875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e2f0-175e-4f4a-8ce6-3efef3cf4996 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.094169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6e2f0-175e-4f4a-8ce6-3efef3cf4996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.111485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-7fa6e2f0-175e-4f4a-8ce6-3efef3cf4996 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:46.112680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7fa6e2f0-175e-4f4a-8ce6-3efef3cf4996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:46.117103 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ee0d3-ecdc-4984-9a2e-7274d797c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.117766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ee0d3-ecdc-4984-9a2e-7274d797c607 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.118090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ee0d3-ecdc-4984-9a2e-7274d797c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.118374 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ee0d3-ecdc-4984-9a2e-7274d797c607 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.119058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ee0d3-ecdc-4984-9a2e-7274d797c607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.120628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1213/2370] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:58:46.121297 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ee0d3-ecdc-4984-9a2e-7274d797c607 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.128772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55186f-e91b-4484-95a1-26787140406d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.129052 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55186f-e91b-4484-95a1-26787140406d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.129324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55186f-e91b-4484-95a1-26787140406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.147057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-de55186f-e91b-4484-95a1-26787140406d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:46.148247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-de55186f-e91b-4484-95a1-26787140406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:46.156823 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1214/2371] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:58:46.166306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55186f-e91b-4484-95a1-26787140406d None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.175035 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55186f-e91b-4484-95a1-26787140406d None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.179631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b66230-d7fc-4b68-84ec-a5ba1304937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.180252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b66230-d7fc-4b68-84ec-a5ba1304937a admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.180533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b66230-d7fc-4b68-84ec-a5ba1304937a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.180802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b66230-d7fc-4b68-84ec-a5ba1304937a admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.181507 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b66230-d7fc-4b68-84ec-a5ba1304937a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:58:46.181860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b66230-d7fc-4b68-84ec-a5ba1304937a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.183479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b66230-d7fc-4b68-84ec-a5ba1304937a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.190771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1158/2372] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:58:45 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:58:46.194525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ee0d3-ecdc-4984-9a2e-7274d797c607 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.198602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1215/2373] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 21:58:46.198734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6c1ee0d3-ecdc-4984-9a2e-7274d797c607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:46.199677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b66230-d7fc-4b68-84ec-a5ba1304937a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.209533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b66230-d7fc-4b68-84ec-a5ba1304937a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.258474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ee0d3-ecdc-4984-9a2e-7274d797c607 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.264230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8210d-9193-441f-a65e-4065f939f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.264600 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e95b7-7248-4900-ba9d-7312a22d17f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.264928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8210d-9193-441f-a65e-4065f939f859 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.265210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8210d-9193-441f-a65e-4065f939f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.265302 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e95b7-7248-4900-ba9d-7312a22d17f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.265487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8210d-9193-441f-a65e-4065f939f859 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.265578 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e95b7-7248-4900-ba9d-7312a22d17f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.265937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e95b7-7248-4900-ba9d-7312a22d17f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.266238 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8210d-9193-441f-a65e-4065f939f859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.266780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e95b7-7248-4900-ba9d-7312a22d17f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.268221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8210d-9193-441f-a65e-4065f939f859 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.268763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e95b7-7248-4900-ba9d-7312a22d17f7 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.371932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1159/2374] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:58:46 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:58:46.375780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8210d-9193-441f-a65e-4065f939f859 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.385506 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8210d-9193-441f-a65e-4065f939f859 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.390221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021a24f-b64e-4258-a93c-2d798f4e8a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.390854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021a24f-b64e-4258-a93c-2d798f4e8a79 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.391122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021a24f-b64e-4258-a93c-2d798f4e8a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.391399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021a24f-b64e-4258-a93c-2d798f4e8a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.392164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021a24f-b64e-4258-a93c-2d798f4e8a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.393717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021a24f-b64e-4258-a93c-2d798f4e8a79 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.403847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1160/2375] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:58:46.407526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021a24f-b64e-4258-a93c-2d798f4e8a79 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.416460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021a24f-b64e-4258-a93c-2d798f4e8a79 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.420991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba14310-d6d0-4994-897f-c2016fb3a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.421578 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14310-d6d0-4994-897f-c2016fb3a66a admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.421890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14310-d6d0-4994-897f-c2016fb3a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.422265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14310-d6d0-4994-897f-c2016fb3a66a admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.422947 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba14310-d6d0-4994-897f-c2016fb3a66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.424450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba14310-d6d0-4994-897f-c2016fb3a66a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.430806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1216/2376] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:58:46 2022] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:58:46.438771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1161/2377] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:58:46.438928 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e95b7-7248-4900-ba9d-7312a22d17f7 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.440467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba14310-d6d0-4994-897f-c2016fb3a66a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.450798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba14310-d6d0-4994-897f-c2016fb3a66a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.497593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e95b7-7248-4900-ba9d-7312a22d17f7 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.502625 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3bbb7-eb07-408a-a4b2-38d93cbc38cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.503290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3bbb7-eb07-408a-a4b2-38d93cbc38cd admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.503574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3bbb7-eb07-408a-a4b2-38d93cbc38cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.503849 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3bbb7-eb07-408a-a4b2-38d93cbc38cd admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.504539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3bbb7-eb07-408a-a4b2-38d93cbc38cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.506484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3bbb7-eb07-408a-a4b2-38d93cbc38cd admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.513128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb23a4-08f5-4542-9630-2fa98ddd782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.513128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb23a4-08f5-4542-9630-2fa98ddd782f admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.513128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb23a4-08f5-4542-9630-2fa98ddd782f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.513431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb23a4-08f5-4542-9630-2fa98ddd782f admin admin] PATH_INFO: `/v3/projects/5a47ca182fae4ddc9723cf621454033b/users/39368169f2fc44c4a27263fe141409dc/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.527525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb23a4-08f5-4542-9630-2fa98ddd782f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a47ca182fae4ddc9723cf621454033b, user_id=39368169f2fc44c4a27263fe141409dc, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.530191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb23a4-08f5-4542-9630-2fa98ddd782f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.600759 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1162/2378] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:58:46 2022] PUT /identity/v3/projects/5a47ca182fae4ddc9723cf621454033b/users/39368169f2fc44c4a27263fe141409dc/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:46.601356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1217/2379] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:58:46 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:58:46.605146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb23a4-08f5-4542-9630-2fa98ddd782f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.612682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3514c6-4f7e-4bf7-8751-c56fa8898204 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.613043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3514c6-4f7e-4bf7-8751-c56fa8898204 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.613389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3514c6-4f7e-4bf7-8751-c56fa8898204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.641330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ee3514c6-4f7e-4bf7-8751-c56fa8898204 None None] MFA Rules not processed for user `39368169f2fc44c4a27263fe141409dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:46.643142 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ee3514c6-4f7e-4bf7-8751-c56fa8898204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:46.669151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb23a4-08f5-4542-9630-2fa98ddd782f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.673817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fb02-4b12-46e4-8772-6dded9b2487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.674503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fb02-4b12-46e4-8772-6dded9b2487b admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.674784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fb02-4b12-46e4-8772-6dded9b2487b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.675059 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112fb02-4b12-46e4-8772-6dded9b2487b admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.675776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112fb02-4b12-46e4-8772-6dded9b2487b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.677367 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112fb02-4b12-46e4-8772-6dded9b2487b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.687494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1163/2380] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:58:46.691363 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fb02-4b12-46e4-8772-6dded9b2487b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.701319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112fb02-4b12-46e4-8772-6dded9b2487b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.704983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1218/2381] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:58:46.705913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d1ab-c591-4ff6-916e-618a11b7ef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.706596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d1ab-c591-4ff6-916e-618a11b7ef91 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.706876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d1ab-c591-4ff6-916e-618a11b7ef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.707146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d1ab-c591-4ff6-916e-618a11b7ef91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.707854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d1ab-c591-4ff6-916e-618a11b7ef91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.709392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3514c6-4f7e-4bf7-8751-c56fa8898204 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.709507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d1ab-c591-4ff6-916e-618a11b7ef91 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.722370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1164/2382] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:58:46.722546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3514c6-4f7e-4bf7-8751-c56fa8898204 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.723646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d1ab-c591-4ff6-916e-618a11b7ef91 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.725278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e624f6-70a7-4aee-91c9-59205a035872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.725925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e624f6-70a7-4aee-91c9-59205a035872 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.726243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e624f6-70a7-4aee-91c9-59205a035872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.726516 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e624f6-70a7-4aee-91c9-59205a035872 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.727228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e624f6-70a7-4aee-91c9-59205a035872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.729258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e624f6-70a7-4aee-91c9-59205a035872 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.733095 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d1ab-c591-4ff6-916e-618a11b7ef91 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.737629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d8ad6-5f71-49ea-adc3-1b22968ff6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.738518 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8ad6-5f71-49ea-adc3-1b22968ff6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.738853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8ad6-5f71-49ea-adc3-1b22968ff6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.739129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8ad6-5f71-49ea-adc3-1b22968ff6b8 admin admin] PATH_INFO: `/v3/projects/94ab53958a76438aa3d93885a4dbe772/users/817ca9985ff94192bc638d2660868575/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.753719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d8ad6-5f71-49ea-adc3-1b22968ff6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ab53958a76438aa3d93885a4dbe772, user_id=817ca9985ff94192bc638d2660868575, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.757616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d8ad6-5f71-49ea-adc3-1b22968ff6b8 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.813903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1219/2383] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:58:46 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:58:46.817835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e624f6-70a7-4aee-91c9-59205a035872 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.841067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1165/2384] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:58:46 2022] PUT /identity/v3/projects/94ab53958a76438aa3d93885a4dbe772/users/817ca9985ff94192bc638d2660868575/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:58:46.857284 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472aa33-57c8-4815-bcd3-b48439b502cf None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.858300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472aa33-57c8-4815-bcd3-b48439b502cf None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.858300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472aa33-57c8-4815-bcd3-b48439b502cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.879360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e624f6-70a7-4aee-91c9-59205a035872 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:46.884248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-d472aa33-57c8-4815-bcd3-b48439b502cf None None] MFA Rules not processed for user `817ca9985ff94192bc638d2660868575`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:46.885515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d472aa33-57c8-4815-bcd3-b48439b502cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:46.933446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072afd3d-1279-475d-a372-6274b1f1e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:46.934148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072afd3d-1279-475d-a372-6274b1f1e9ac admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:46.934430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072afd3d-1279-475d-a372-6274b1f1e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:46.934705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072afd3d-1279-475d-a372-6274b1f1e9ac admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:46.935393 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072afd3d-1279-475d-a372-6274b1f1e9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:46.937460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072afd3d-1279-475d-a372-6274b1f1e9ac admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:46.949959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1166/2385] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:58:46.960568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472aa33-57c8-4815-bcd3-b48439b502cf None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:46.962181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d472aa33-57c8-4815-bcd3-b48439b502cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:47.016104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472aa33-57c8-4815-bcd3-b48439b502cf None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:47.019817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8aca8-2b02-4bf6-b8d7-d5e0f760c081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:47.020450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8aca8-2b02-4bf6-b8d7-d5e0f760c081 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:47.020841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8aca8-2b02-4bf6-b8d7-d5e0f760c081 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:47.021171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8aca8-2b02-4bf6-b8d7-d5e0f760c081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:47.030528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8aca8-2b02-4bf6-b8d7-d5e0f760c081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:47.032017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8aca8-2b02-4bf6-b8d7-d5e0f760c081 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:47.040835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1167/2386] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:58:47.064071 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1220/2387] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:58:46 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:58:47.075845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8aca8-2b02-4bf6-b8d7-d5e0f760c081 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:47.087615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8aca8-2b02-4bf6-b8d7-d5e0f760c081 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:47.092835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a4eeb-7764-4257-be33-3e61913d1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:47.093488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a4eeb-7764-4257-be33-3e61913d1fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:47.093770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a4eeb-7764-4257-be33-3e61913d1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:47.094129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a4eeb-7764-4257-be33-3e61913d1fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:47.094860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a4eeb-7764-4257-be33-3e61913d1fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:47.096485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a4eeb-7764-4257-be33-3e61913d1fc6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:47.108918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1168/2388] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:58:47.111074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072afd3d-1279-475d-a372-6274b1f1e9ac admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:47.120616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072afd3d-1279-475d-a372-6274b1f1e9ac admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:47.125090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0b9fb-84aa-4ffd-bd5f-cc2cf30dcc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:47.125961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0b9fb-84aa-4ffd-bd5f-cc2cf30dcc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:47.127486 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0b9fb-84aa-4ffd-bd5f-cc2cf30dcc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:47.127997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0b9fb-84aa-4ffd-bd5f-cc2cf30dcc32 admin admin] PATH_INFO: `/v3/projects/c33f03626810422d822ad167389e1909/users/dda6999374b342718499294e36d59115/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:47.143056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0b9fb-84aa-4ffd-bd5f-cc2cf30dcc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33f03626810422d822ad167389e1909, user_id=dda6999374b342718499294e36d59115, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:47.145693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0b9fb-84aa-4ffd-bd5f-cc2cf30dcc32 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:47.256194 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1221/2389] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:58:47 2022] PUT /identity/v3/projects/c33f03626810422d822ad167389e1909/users/dda6999374b342718499294e36d59115/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:47.260961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a4eeb-7764-4257-be33-3e61913d1fc6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:47.270805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a4eeb-7764-4257-be33-3e61913d1fc6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:47.325335 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692210d-75fa-4ae1-9c04-cfee32030c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:47.326011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692210d-75fa-4ae1-9c04-cfee32030c89 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:47.326301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692210d-75fa-4ae1-9c04-cfee32030c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:47.326572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692210d-75fa-4ae1-9c04-cfee32030c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:47.327292 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692210d-75fa-4ae1-9c04-cfee32030c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:47.328887 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692210d-75fa-4ae1-9c04-cfee32030c89 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:47.338847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1169/2390] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:58:47.343315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0b9fb-84aa-4ffd-bd5f-cc2cf30dcc32 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:47.353301 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0b9fb-84aa-4ffd-bd5f-cc2cf30dcc32 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:47.358317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126c393-7d50-41d3-89c1-a0e6f0e5fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:47.359216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126c393-7d50-41d3-89c1-a0e6f0e5fe8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:47.359490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126c393-7d50-41d3-89c1-a0e6f0e5fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:47.359760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126c393-7d50-41d3-89c1-a0e6f0e5fe8d admin admin] PATH_INFO: `/v3/projects/c33f03626810422d822ad167389e1909/users/dda6999374b342718499294e36d59115/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:47.361698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126c393-7d50-41d3-89c1-a0e6f0e5fe8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33f03626810422d822ad167389e1909, user_id=dda6999374b342718499294e36d59115, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:47.364392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126c393-7d50-41d3-89c1-a0e6f0e5fe8d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:47.374953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1222/2391] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:58:47 2022] PUT /identity/v3/projects/c33f03626810422d822ad167389e1909/users/dda6999374b342718499294e36d59115/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:58:47.384821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b823-9618-4855-a2f0-a753cffef57d None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:47.385905 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b823-9618-4855-a2f0-a753cffef57d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:47.386215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b823-9618-4855-a2f0-a753cffef57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:47.413314 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-94e6b823-9618-4855-a2f0-a753cffef57d None None] MFA Rules not processed for user `dda6999374b342718499294e36d59115`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:58:47.414549 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-94e6b823-9618-4855-a2f0-a753cffef57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:47.480359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1170/2392] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:58:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:58:47.491654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126c393-7d50-41d3-89c1-a0e6f0e5fe8d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:47.548680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126c393-7d50-41d3-89c1-a0e6f0e5fe8d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:47.552420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb1ffe-8303-440e-a327-052032249130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:47.553054 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1ffe-8303-440e-a327-052032249130 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:47.553407 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1ffe-8303-440e-a327-052032249130 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:47.553625 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1ffe-8303-440e-a327-052032249130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:47.555471 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-56bb1ffe-8303-440e-a327-052032249130 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:58:47.613241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb1ffe-8303-440e-a327-052032249130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:47.614681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb1ffe-8303-440e-a327-052032249130 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:47.623568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1223/2393] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:58:50.670270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b823-9618-4855-a2f0-a753cffef57d None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:50.689231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b823-9618-4855-a2f0-a753cffef57d None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:50.693062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aed674-a5e3-4236-afdb-eb9e6e29d03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:50.693685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aed674-a5e3-4236-afdb-eb9e6e29d03c service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:50.693960 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aed674-a5e3-4236-afdb-eb9e6e29d03c service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:50.694261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aed674-a5e3-4236-afdb-eb9e6e29d03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:50.747975 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aed674-a5e3-4236-afdb-eb9e6e29d03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:50.749408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aed674-a5e3-4236-afdb-eb9e6e29d03c service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:50.758054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1171/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:58:53.838842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb1ffe-8303-440e-a327-052032249130 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:58:53.857449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb1ffe-8303-440e-a327-052032249130 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:58:53.860685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575ee5f-eda5-4182-9746-046ca1cef619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:58:53.861323 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575ee5f-eda5-4182-9746-046ca1cef619 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:58:53.861602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575ee5f-eda5-4182-9746-046ca1cef619 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:58:53.861875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575ee5f-eda5-4182-9746-046ca1cef619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:58:53.870817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575ee5f-eda5-4182-9746-046ca1cef619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:58:53.872298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575ee5f-eda5-4182-9746-046ca1cef619 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:58:53.881561 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1224/2395] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:58:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:59:07.358147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aed674-a5e3-4236-afdb-eb9e6e29d03c service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:07.421702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aed674-a5e3-4236-afdb-eb9e6e29d03c service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:07.427227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:07.428133 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:07.429006 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:07.429290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] PATH_INFO: `/v3/users/a87435282fe84a7c924afe4e2dc1731b` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:07.430557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87435282fe84a7c924afe4e2dc1731b)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:07.432570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:07.677605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87435282fe84a7c924afe4e2dc1731b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:07.678203 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87435282fe84a7c924afe4e2dc1731b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:07.752649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87435282fe84a7c924afe4e2dc1731b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:07.759747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87435282fe84a7c924afe4e2dc1731b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:07.771626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87435282fe84a7c924afe4e2dc1731b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:07.777384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1172/2396] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:59:07 2022] DELETE /identity/v3/users/a87435282fe84a7c924afe4e2dc1731b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:59:07.782582 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b189-04c3-425a-8284-c4eb3c8e5802 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:07.783153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b189-04c3-425a-8284-c4eb3c8e5802 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:07.783153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b189-04c3-425a-8284-c4eb3c8e5802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:07.799996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e7e6b189-04c3-425a-8284-c4eb3c8e5802 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:07.801158 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e7e6b189-04c3-425a-8284-c4eb3c8e5802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:07.858319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1225/2397] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:07.868165 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:07.869616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:07.925766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf975f6-debe-4046-b36c-88bdd31daa4e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:07.929790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a48db8-014e-4cc0-bd2b-65a10258f54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:07.930406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48db8-014e-4cc0-bd2b-65a10258f54e service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:07.930684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48db8-014e-4cc0-bd2b-65a10258f54e service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:07.930955 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48db8-014e-4cc0-bd2b-65a10258f54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:07.940449 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a48db8-014e-4cc0-bd2b-65a10258f54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:07.941876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a48db8-014e-4cc0-bd2b-65a10258f54e service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:07.952099 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1173/2398] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:59:08.396871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b189-04c3-425a-8284-c4eb3c8e5802 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:08.404617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e7e6b189-04c3-425a-8284-c4eb3c8e5802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:08.417567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b189-04c3-425a-8284-c4eb3c8e5802 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:08.423567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:08.424521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:08.424797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:08.425066 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] PATH_INFO: `/v3/projects/37afd0d48df643ed91fab2520770c09b` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:08.426417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37afd0d48df643ed91fab2520770c09b)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:08.428525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:08.658734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37afd0d48df643ed91fab2520770c09b', 'request_id': 'req-c18bda60-b70b-46af-ae3a-adddf093a784'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:08.664945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37afd0d48df643ed91fab2520770c09b', 'request_id': 'req-c18bda60-b70b-46af-ae3a-adddf093a784'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:08.800656 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37afd0d48df643ed91fab2520770c09b', 'request_id': 'req-c18bda60-b70b-46af-ae3a-adddf093a784'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:08.823325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] The token cache is being invalidate because project 37afd0d48df643ed91fab2520770c09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:59:08.823325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:08.823325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:08.823325 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1226/2399] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:59:08 2022] DELETE /identity/v3/projects/37afd0d48df643ed91fab2520770c09b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:59:08.825306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a48db8-014e-4cc0-bd2b-65a10258f54e service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:08.836580 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a48db8-014e-4cc0-bd2b-65a10258f54e service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:08.897902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:08.898923 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:08.899270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:08.899647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] PATH_INFO: `/v3/users/39368169f2fc44c4a27263fe141409dc` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:08.900855 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39368169f2fc44c4a27263fe141409dc)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:08.903405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:09.174487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39368169f2fc44c4a27263fe141409dc'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:09.175123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39368169f2fc44c4a27263fe141409dc'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:09.255264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39368169f2fc44c4a27263fe141409dc'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:09.263260 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39368169f2fc44c4a27263fe141409dc'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:09.275587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39368169f2fc44c4a27263fe141409dc'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:09.282304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1174/2400] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:59:08 2022] DELETE /identity/v3/users/39368169f2fc44c4a27263fe141409dc => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:59:09.615634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:09.623501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:09.631896 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bda60-b70b-46af-ae3a-adddf093a784 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:09.686889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:09.687762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:09.688042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:09.688317 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] PATH_INFO: `/v3/users/817ca9985ff94192bc638d2660868575` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:09.689676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=817ca9985ff94192bc638d2660868575)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:09.691620 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:10.026763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817ca9985ff94192bc638d2660868575'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.034670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817ca9985ff94192bc638d2660868575'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.104883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:10.106401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:10.119577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e382f-4212-4834-a66d-273bc627dab3 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:10.125548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:10.127813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:10.128485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:10.128857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] PATH_INFO: `/v3/projects/5a47ca182fae4ddc9723cf621454033b` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:10.130862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a47ca182fae4ddc9723cf621454033b)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:10.133479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:10.139036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817ca9985ff94192bc638d2660868575'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.153773 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817ca9985ff94192bc638d2660868575'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.154526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4847f556-95e1-4d4b-a0a9-a6f45361a624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817ca9985ff94192bc638d2660868575'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.160504 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1227/2401] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:59:09 2022] DELETE /identity/v3/users/817ca9985ff94192bc638d2660868575 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:59:10.165180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18af81f-b532-4ca6-a538-91c2f10590dd None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:10.165456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18af81f-b532-4ca6-a538-91c2f10590dd None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:10.165732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18af81f-b532-4ca6-a538-91c2f10590dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:10.184045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-c18af81f-b532-4ca6-a538-91c2f10590dd None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:10.185427 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c18af81f-b532-4ca6-a538-91c2f10590dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:10.241306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1228/2402] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:59:10.251138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18af81f-b532-4ca6-a538-91c2f10590dd None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:10.252588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c18af81f-b532-4ca6-a538-91c2f10590dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:10.279837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a47ca182fae4ddc9723cf621454033b', 'request_id': 'req-9c6401a2-e4d7-4a55-b79c-c4be984ae773'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.286356 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a47ca182fae4ddc9723cf621454033b', 'request_id': 'req-9c6401a2-e4d7-4a55-b79c-c4be984ae773'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.295140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a47ca182fae4ddc9723cf621454033b', 'request_id': 'req-9c6401a2-e4d7-4a55-b79c-c4be984ae773'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.310467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18af81f-b532-4ca6-a538-91c2f10590dd None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:10.359414 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede0e64-d8c5-4484-9b9c-812accf22fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:10.360108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede0e64-d8c5-4484-9b9c-812accf22fdf service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:10.360328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede0e64-d8c5-4484-9b9c-812accf22fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:10.360597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede0e64-d8c5-4484-9b9c-812accf22fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:10.383509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] The token cache is being invalidate because project 5a47ca182fae4ddc9723cf621454033b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:59:10.385161 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.385161 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.386635 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1175/2403] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:59:10 2022] DELETE /identity/v3/projects/5a47ca182fae4ddc9723cf621454033b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:59:10.391049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:10.392366 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:10.421414 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede0e64-d8c5-4484-9b9c-812accf22fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:10.423005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede0e64-d8c5-4484-9b9c-812accf22fdf service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:10.432863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1229/2404] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 21:59:10.455767 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6401a2-e4d7-4a55-b79c-c4be984ae773 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:10.460724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:10.461879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:10.462189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:10.462463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] PATH_INFO: `/v3/users/dda6999374b342718499294e36d59115` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:10.463671 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda6999374b342718499294e36d59115)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:10.465753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:10.696328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda6999374b342718499294e36d59115'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.697170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda6999374b342718499294e36d59115'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.789117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda6999374b342718499294e36d59115'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.797422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda6999374b342718499294e36d59115'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.811970 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda6999374b342718499294e36d59115'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:10.818699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1176/2405] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:59:10 2022] DELETE /identity/v3/users/dda6999374b342718499294e36d59115 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:59:10.856944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede0e64-d8c5-4484-9b9c-812accf22fdf service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:10.858429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4ede0e64-d8c5-4484-9b9c-812accf22fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:10.895682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:10.897202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:10.965813 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede0e64-d8c5-4484-9b9c-812accf22fdf service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:10.977374 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc9c01-edaa-417e-947a-fb86db78ed02 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:10.983246 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:10.984120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:10.984547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:10.984659 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] PATH_INFO: `/v3/projects/94ab53958a76438aa3d93885a4dbe772` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:10.985861 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ab53958a76438aa3d93885a4dbe772)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:10.988307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:11.038305 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51914d19-a107-4d25-b259-829d5c48046b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1875af7b72b247c9a2b5e1f2b2fb1eaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:11.039049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51914d19-a107-4d25-b259-829d5c48046b service placement] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:11.039331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51914d19-a107-4d25-b259-829d5c48046b service placement] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:11.039605 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51914d19-a107-4d25-b259-829d5c48046b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:11.041361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-51914d19-a107-4d25-b259-829d5c48046b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:11.053392 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51914d19-a107-4d25-b259-829d5c48046b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:11.055012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51914d19-a107-4d25-b259-829d5c48046b service placement] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:11.065497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1230/2406] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:59:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:59:11.136804 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ab53958a76438aa3d93885a4dbe772', 'request_id': 'req-6a2ab531-2379-4501-a705-8138b12319aa'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:11.143776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ab53958a76438aa3d93885a4dbe772', 'request_id': 'req-6a2ab531-2379-4501-a705-8138b12319aa'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:11.149512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ab53958a76438aa3d93885a4dbe772', 'request_id': 'req-6a2ab531-2379-4501-a705-8138b12319aa'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:11.254879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] The token cache is being invalidate because project 94ab53958a76438aa3d93885a4dbe772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:59:11.255163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:11.258534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6a2ab531-2379-4501-a705-8138b12319aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:11.258534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1177/2407] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:59:10 2022] DELETE /identity/v3/projects/94ab53958a76438aa3d93885a4dbe772 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:59:11.320163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51914d19-a107-4d25-b259-829d5c48046b service placement] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:11.322094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-51914d19-a107-4d25-b259-829d5c48046b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:11.349550 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51914d19-a107-4d25-b259-829d5c48046b service placement] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:11.418293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:11.419239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:11.419501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:11.419801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] PATH_INFO: `/v3/projects/c33f03626810422d822ad167389e1909` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:11.421051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33f03626810422d822ad167389e1909)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:11.423013 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:11.611018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33f03626810422d822ad167389e1909', 'request_id': 'req-89a9f062-06d0-4822-afe7-28d9f8941d67'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:11.617045 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33f03626810422d822ad167389e1909', 'request_id': 'req-89a9f062-06d0-4822-afe7-28d9f8941d67'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:11.700730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33f03626810422d822ad167389e1909', 'request_id': 'req-89a9f062-06d0-4822-afe7-28d9f8941d67'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:11.714187 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] The token cache is being invalidate because project c33f03626810422d822ad167389e1909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:59:11.714480 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:11.715321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-89a9f062-06d0-4822-afe7-28d9f8941d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:11.717206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1231/2408] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:59:11 2022] DELETE /identity/v3/projects/c33f03626810422d822ad167389e1909 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:59:11.722362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c2856-a63d-4311-9ad7-c17707307b0c None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:11.722653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c2856-a63d-4311-9ad7-c17707307b0c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:11.722931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c2856-a63d-4311-9ad7-c17707307b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:11.742508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1e5c2856-a63d-4311-9ad7-c17707307b0c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:11.743728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1e5c2856-a63d-4311-9ad7-c17707307b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:11.803765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1178/2409] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:11.813593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1befd4-de54-43b7-a6c4-889a87ea3918 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:11.814114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1befd4-de54-43b7-a6c4-889a87ea3918 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:11.814494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1befd4-de54-43b7-a6c4-889a87ea3918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:11.832719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ed1befd4-de54-43b7-a6c4-889a87ea3918 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:11.834119 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ed1befd4-de54-43b7-a6c4-889a87ea3918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:11.842791 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1232/2410] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:11.847042 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c2856-a63d-4311-9ad7-c17707307b0c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:11.859390 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c2856-a63d-4311-9ad7-c17707307b0c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:11.864155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda4b9-6005-4b19-bf9d-e00d1a0e41bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:11.864817 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda4b9-6005-4b19-bf9d-e00d1a0e41bc admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:11.865120 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda4b9-6005-4b19-bf9d-e00d1a0e41bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:11.865397 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfda4b9-6005-4b19-bf9d-e00d1a0e41bc admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:11.866155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfda4b9-6005-4b19-bf9d-e00d1a0e41bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:59:11.866466 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfda4b9-6005-4b19-bf9d-e00d1a0e41bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:11.868347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfda4b9-6005-4b19-bf9d-e00d1a0e41bc admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:11.884008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1179/2411] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:59:11.888386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1befd4-de54-43b7-a6c4-889a87ea3918 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:11.897483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1befd4-de54-43b7-a6c4-889a87ea3918 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:11.902214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3048-af4d-43e6-87ae-b1d0435a8c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:11.903425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3048-af4d-43e6-87ae-b1d0435a8c16 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:11.903703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3048-af4d-43e6-87ae-b1d0435a8c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:11.903971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3048-af4d-43e6-87ae-b1d0435a8c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:11.904653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b3048-af4d-43e6-87ae-b1d0435a8c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:11.906571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b3048-af4d-43e6-87ae-b1d0435a8c16 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:12.004730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1233/2412] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:59:11 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:59:12.005743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda4b9-6005-4b19-bf9d-e00d1a0e41bc admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:12.015520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfda4b9-6005-4b19-bf9d-e00d1a0e41bc admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:12.071957 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff2348-d49d-404c-b0a3-22378f9dcad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:12.072623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff2348-d49d-404c-b0a3-22378f9dcad6 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:12.072903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff2348-d49d-404c-b0a3-22378f9dcad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:12.073180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff2348-d49d-404c-b0a3-22378f9dcad6 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:12.073874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff2348-d49d-404c-b0a3-22378f9dcad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:12.075933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff2348-d49d-404c-b0a3-22378f9dcad6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:12.183224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1180/2413] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:59:12 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:59:12.187492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3048-af4d-43e6-87ae-b1d0435a8c16 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:12.197722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3048-af4d-43e6-87ae-b1d0435a8c16 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:12.202599 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683a84a-6cf4-4728-b582-918f91ae452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:12.203269 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683a84a-6cf4-4728-b582-918f91ae452d admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:12.203551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683a84a-6cf4-4728-b582-918f91ae452d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:12.203827 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683a84a-6cf4-4728-b582-918f91ae452d admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:12.204561 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683a84a-6cf4-4728-b582-918f91ae452d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:12.206187 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683a84a-6cf4-4728-b582-918f91ae452d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:12.217676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1234/2414] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:59:12.222105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff2348-d49d-404c-b0a3-22378f9dcad6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:12.235075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff2348-d49d-404c-b0a3-22378f9dcad6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:12.239523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9fd80-37d7-45cd-b502-a3daea7b732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:12.240371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9fd80-37d7-45cd-b502-a3daea7b732b admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:12.240900 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9fd80-37d7-45cd-b502-a3daea7b732b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:12.241272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9fd80-37d7-45cd-b502-a3daea7b732b admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:12.242206 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9fd80-37d7-45cd-b502-a3daea7b732b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:12.243828 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9fd80-37d7-45cd-b502-a3daea7b732b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:12.254474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1181/2415] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:59:12.258719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683a84a-6cf4-4728-b582-918f91ae452d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:12.269818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683a84a-6cf4-4728-b582-918f91ae452d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:12.274580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd7d22-416f-4c5c-a1a7-ad021ab12b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:12.280781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd7d22-416f-4c5c-a1a7-ad021ab12b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:12.280781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd7d22-416f-4c5c-a1a7-ad021ab12b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:12.280781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd7d22-416f-4c5c-a1a7-ad021ab12b22 admin admin] PATH_INFO: `/v3/projects/c4acca99140647f0b63399d2c4bc095e/users/457b1e5c52e5439981bb01b3ecabf9d0/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:12.294026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd7d22-416f-4c5c-a1a7-ad021ab12b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4acca99140647f0b63399d2c4bc095e, user_id=457b1e5c52e5439981bb01b3ecabf9d0, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:12.296666 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd7d22-416f-4c5c-a1a7-ad021ab12b22 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:12.435114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1235/2416] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:59:12 2022] PUT /identity/v3/projects/c4acca99140647f0b63399d2c4bc095e/users/457b1e5c52e5439981bb01b3ecabf9d0/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:59:12.440225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97697e-ab56-4343-9fcc-6a3f3c98f086 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:12.440522 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97697e-ab56-4343-9fcc-6a3f3c98f086 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:12.440803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97697e-ab56-4343-9fcc-6a3f3c98f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:12.458845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6d97697e-ab56-4343-9fcc-6a3f3c98f086 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:12.460083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6d97697e-ab56-4343-9fcc-6a3f3c98f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:12.532116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1182/2417] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:12.541574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd7d22-416f-4c5c-a1a7-ad021ab12b22 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:12.543455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ddbd7d22-416f-4c5c-a1a7-ad021ab12b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:12.602292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd7d22-416f-4c5c-a1a7-ad021ab12b22 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:12.605930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72a22-ea33-400d-8725-bc9b7ee86139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:12.606601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72a22-ea33-400d-8725-bc9b7ee86139 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:12.606884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72a22-ea33-400d-8725-bc9b7ee86139 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:12.607161 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72a22-ea33-400d-8725-bc9b7ee86139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:12.615957 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72a22-ea33-400d-8725-bc9b7ee86139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:12.617822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72a22-ea33-400d-8725-bc9b7ee86139 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:12.627857 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1236/2418] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:59:13.298500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97697e-ab56-4343-9fcc-6a3f3c98f086 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:13.299966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6d97697e-ab56-4343-9fcc-6a3f3c98f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:13.312508 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97697e-ab56-4343-9fcc-6a3f3c98f086 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:13.318586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:13.319480 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:13.319757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:13.320029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] PATH_INFO: `/v3/users/e45f306d55b3414bbc281e3372e0225c` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:13.321266 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45f306d55b3414bbc281e3372e0225c)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:13.323348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:13.573075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45f306d55b3414bbc281e3372e0225c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:13.573720 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45f306d55b3414bbc281e3372e0225c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:13.677820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45f306d55b3414bbc281e3372e0225c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:13.685732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45f306d55b3414bbc281e3372e0225c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:13.698009 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45f306d55b3414bbc281e3372e0225c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:13.704128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1183/2419] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:59:13 2022] DELETE /identity/v3/users/e45f306d55b3414bbc281e3372e0225c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:59:13.708515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40224260-9197-467c-98aa-f9f096a78826 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:13.708976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40224260-9197-467c-98aa-f9f096a78826 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:13.709089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40224260-9197-467c-98aa-f9f096a78826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:13.727234 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-40224260-9197-467c-98aa-f9f096a78826 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:13.728435 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-40224260-9197-467c-98aa-f9f096a78826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:13.789001 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1237/2420] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:13.798932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:13.800184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:13.855722 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074172d-bd90-4e33-a787-b2440e2796f7 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:13.859361 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d08f6-72a1-4d37-8718-d7e90d0a22df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:13.860000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d08f6-72a1-4d37-8718-d7e90d0a22df service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:13.860274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d08f6-72a1-4d37-8718-d7e90d0a22df service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:13.860546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d08f6-72a1-4d37-8718-d7e90d0a22df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:13.869519 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d08f6-72a1-4d37-8718-d7e90d0a22df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:13.870910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d08f6-72a1-4d37-8718-d7e90d0a22df service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:13.882931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1184/2421] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:59:14.122051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9ef7-1a84-4536-bc7d-5a54c2cb886c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:14.122521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9ef7-1a84-4536-bc7d-5a54c2cb886c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:14.122846 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9ef7-1a84-4536-bc7d-5a54c2cb886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:14.157447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-c81f9ef7-1a84-4536-bc7d-5a54c2cb886c None None] MFA Rules not processed for user `457b1e5c52e5439981bb01b3ecabf9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:14.158717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c81f9ef7-1a84-4536-bc7d-5a54c2cb886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:14.227878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1238/2422] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:14.239814 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d08f6-72a1-4d37-8718-d7e90d0a22df service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:14.241221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5a2d08f6-72a1-4d37-8718-d7e90d0a22df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:14.307641 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d08f6-72a1-4d37-8718-d7e90d0a22df service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:14.313085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f1609-e4e2-4828-87ee-ac9217f59d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:14.313931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1609-e4e2-4828-87ee-ac9217f59d7b service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:14.314251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1609-e4e2-4828-87ee-ac9217f59d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:14.314548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f1609-e4e2-4828-87ee-ac9217f59d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:14.322931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f1609-e4e2-4828-87ee-ac9217f59d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:14.324434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f1609-e4e2-4828-87ee-ac9217f59d7b service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:14.334648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1185/2423] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:59:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:59:14.367782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f9ef7-1a84-4536-bc7d-5a54c2cb886c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:14.369332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c81f9ef7-1a84-4536-bc7d-5a54c2cb886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:14.398631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f9ef7-1a84-4536-bc7d-5a54c2cb886c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:14.405140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:14.406853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:14.407141 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:14.407537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] PATH_INFO: `/v3/projects/645aaf2aa32e48cb94ada50bed462c26` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:14.408645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=645aaf2aa32e48cb94ada50bed462c26)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:14.410627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:14.582932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645aaf2aa32e48cb94ada50bed462c26', 'request_id': 'req-9286e080-912a-4669-9b11-92b3675a0a08'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:14.589295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645aaf2aa32e48cb94ada50bed462c26', 'request_id': 'req-9286e080-912a-4669-9b11-92b3675a0a08'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:14.714482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645aaf2aa32e48cb94ada50bed462c26', 'request_id': 'req-9286e080-912a-4669-9b11-92b3675a0a08'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:14.725525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] The token cache is being invalidate because project 645aaf2aa32e48cb94ada50bed462c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:59:14.725817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:14.726497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-9286e080-912a-4669-9b11-92b3675a0a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:14.728057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1239/2424] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:59:14 2022] DELETE /identity/v3/projects/645aaf2aa32e48cb94ada50bed462c26 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:59:14.733475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3bc1f-4a09-43d1-bb4b-b2b18e977a7d None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:14.733769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3bc1f-4a09-43d1-bb4b-b2b18e977a7d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:14.734102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3bc1f-4a09-43d1-bb4b-b2b18e977a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:14.752485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f8b3bc1f-4a09-43d1-bb4b-b2b18e977a7d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:14.753788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f8b3bc1f-4a09-43d1-bb4b-b2b18e977a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:14.811405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1186/2425] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 21:59:14.819223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b3483-f3f5-4a59-b2c7-b0c74bcc2e44 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:14.819511 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b3483-f3f5-4a59-b2c7-b0c74bcc2e44 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:14.819966 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b3483-f3f5-4a59-b2c7-b0c74bcc2e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:14.838134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e27b3483-f3f5-4a59-b2c7-b0c74bcc2e44 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:14.839318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e27b3483-f3f5-4a59-b2c7-b0c74bcc2e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:14.847220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1240/2426] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:14.851464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3bc1f-4a09-43d1-bb4b-b2b18e977a7d None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:14.861615 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3bc1f-4a09-43d1-bb4b-b2b18e977a7d None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:14.866232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1896-c6c6-4844-aa11-956c243711ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:14.866883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1896-c6c6-4844-aa11-956c243711ae admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:14.867173 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1896-c6c6-4844-aa11-956c243711ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:14.867437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1896-c6c6-4844-aa11-956c243711ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:14.868155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f1896-c6c6-4844-aa11-956c243711ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:59:14.868460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f1896-c6c6-4844-aa11-956c243711ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:14.870092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f1896-c6c6-4844-aa11-956c243711ae admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:14.882012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1187/2427] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:59:14.886274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b3483-f3f5-4a59-b2c7-b0c74bcc2e44 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:14.895567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b3483-f3f5-4a59-b2c7-b0c74bcc2e44 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:14.900276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff6cf6-ad1e-45cd-9df2-eccb5791d149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:14.900915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff6cf6-ad1e-45cd-9df2-eccb5791d149 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:14.901196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff6cf6-ad1e-45cd-9df2-eccb5791d149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:14.901471 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff6cf6-ad1e-45cd-9df2-eccb5791d149 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:14.902247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff6cf6-ad1e-45cd-9df2-eccb5791d149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:14.904835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff6cf6-ad1e-45cd-9df2-eccb5791d149 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:15.039616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1241/2428] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:59:14 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:59:15.044400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1896-c6c6-4844-aa11-956c243711ae admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:15.054687 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1896-c6c6-4844-aa11-956c243711ae admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:15.109829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeaf0f-e01a-4403-8f57-5c314085ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:15.110543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeaf0f-e01a-4403-8f57-5c314085ba7a admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:15.110820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeaf0f-e01a-4403-8f57-5c314085ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:15.111091 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeaf0f-e01a-4403-8f57-5c314085ba7a admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:15.111775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aeaf0f-e01a-4403-8f57-5c314085ba7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:15.113674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aeaf0f-e01a-4403-8f57-5c314085ba7a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:15.219643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1188/2429] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:59:15 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 21:59:15.224188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff6cf6-ad1e-45cd-9df2-eccb5791d149 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:15.231747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff6cf6-ad1e-45cd-9df2-eccb5791d149 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:15.236372 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930c21c-53c4-4bc1-ae4b-7ae26fbbf886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:15.237020 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930c21c-53c4-4bc1-ae4b-7ae26fbbf886 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:15.237298 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930c21c-53c4-4bc1-ae4b-7ae26fbbf886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:15.237574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930c21c-53c4-4bc1-ae4b-7ae26fbbf886 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:15.238326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930c21c-53c4-4bc1-ae4b-7ae26fbbf886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:15.239899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930c21c-53c4-4bc1-ae4b-7ae26fbbf886 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:15.251856 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1242/2430] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:59:15.255954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeaf0f-e01a-4403-8f57-5c314085ba7a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:15.266865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeaf0f-e01a-4403-8f57-5c314085ba7a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:15.271871 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8320e8-70b0-4aea-bb92-f57ec4f93f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:15.272409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8320e8-70b0-4aea-bb92-f57ec4f93f9f admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:15.272693 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8320e8-70b0-4aea-bb92-f57ec4f93f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:15.272971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8320e8-70b0-4aea-bb92-f57ec4f93f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:15.273697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8320e8-70b0-4aea-bb92-f57ec4f93f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:15.275330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8320e8-70b0-4aea-bb92-f57ec4f93f9f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:15.289962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1189/2431] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:59:15.291094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930c21c-53c4-4bc1-ae4b-7ae26fbbf886 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:15.301193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930c21c-53c4-4bc1-ae4b-7ae26fbbf886 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:15.305752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2cb19-7f63-4f06-ad0e-919f694cb951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:15.306661 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2cb19-7f63-4f06-ad0e-919f694cb951 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:15.306938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2cb19-7f63-4f06-ad0e-919f694cb951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:15.307204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2cb19-7f63-4f06-ad0e-919f694cb951 admin admin] PATH_INFO: `/v3/projects/c2cf6ce6c6054c83aa7f4ad7fd703a7a/users/9af9a951071d44488fc3bf58246088fb/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:15.322586 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2cb19-7f63-4f06-ad0e-919f694cb951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2cf6ce6c6054c83aa7f4ad7fd703a7a, user_id=9af9a951071d44488fc3bf58246088fb, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:15.326663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2cb19-7f63-4f06-ad0e-919f694cb951 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:15.473495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1243/2432] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:59:15 2022] PUT /identity/v3/projects/c2cf6ce6c6054c83aa7f4ad7fd703a7a/users/9af9a951071d44488fc3bf58246088fb/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 21:59:15.483932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600a064-0b5c-44ce-93a3-79801519b02f None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:15.484422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600a064-0b5c-44ce-93a3-79801519b02f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:15.484516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600a064-0b5c-44ce-93a3-79801519b02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:15.510261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-7600a064-0b5c-44ce-93a3-79801519b02f None None] MFA Rules not processed for user `9af9a951071d44488fc3bf58246088fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:15.511437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7600a064-0b5c-44ce-93a3-79801519b02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:15.576636 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1190/2433] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:15.588575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2cb19-7f63-4f06-ad0e-919f694cb951 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:15.590914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f5a2cb19-7f63-4f06-ad0e-919f694cb951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:15.646790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2cb19-7f63-4f06-ad0e-919f694cb951 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:15.650505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750fd3-0270-4b63-9b8f-a3b8b2f7e4ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:15.651143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750fd3-0270-4b63-9b8f-a3b8b2f7e4ab service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:15.651415 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750fd3-0270-4b63-9b8f-a3b8b2f7e4ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:15.651683 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06750fd3-0270-4b63-9b8f-a3b8b2f7e4ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:15.660148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06750fd3-0270-4b63-9b8f-a3b8b2f7e4ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:15.661659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06750fd3-0270-4b63-9b8f-a3b8b2f7e4ab service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:15.670472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1244/2434] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:59:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:59:16.274130 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc7ca-52ee-4fe1-ad74-bb4661acc64e None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:16.274426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc7ca-52ee-4fe1-ad74-bb4661acc64e None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:16.274704 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbc7ca-52ee-4fe1-ad74-bb4661acc64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:16.292820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-06fbc7ca-52ee-4fe1-ad74-bb4661acc64e None None] MFA Rules not processed for user `457b1e5c52e5439981bb01b3ecabf9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:16.294646 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-06fbc7ca-52ee-4fe1-ad74-bb4661acc64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:16.349721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1191/2435] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:38.723268 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750fd3-0270-4b63-9b8f-a3b8b2f7e4ab service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:38.725037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-06750fd3-0270-4b63-9b8f-a3b8b2f7e4ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:38.790135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06750fd3-0270-4b63-9b8f-a3b8b2f7e4ab service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:38.795630 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:38.796535 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:38.796816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:38.797090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] PATH_INFO: `/v3/users/4bf68aa698e54763a62cb65727a9e7c3` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:38.798419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf68aa698e54763a62cb65727a9e7c3)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:38.800256 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:39.004783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf68aa698e54763a62cb65727a9e7c3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:39.011286 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf68aa698e54763a62cb65727a9e7c3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:39.134366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf68aa698e54763a62cb65727a9e7c3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:39.147282 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf68aa698e54763a62cb65727a9e7c3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:39.148002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-d9f3aee9-5fc4-4a9b-8656-410de31e2d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf68aa698e54763a62cb65727a9e7c3'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:39.154690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1245/2436] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 21:59:38 2022] DELETE /identity/v3/users/4bf68aa698e54763a62cb65727a9e7c3 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:59:39.428044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc7ca-52ee-4fe1-ad74-bb4661acc64e None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:39.440150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbc7ca-52ee-4fe1-ad74-bb4661acc64e None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:39.496255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:39.497785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:39.498282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:39.504443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] PATH_INFO: `/v3/projects/98ff64b9ef40408aaa1f8860bbd16b5f` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:39.504443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ff64b9ef40408aaa1f8860bbd16b5f)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:39.504443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:39.634467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ff64b9ef40408aaa1f8860bbd16b5f', 'request_id': 'req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:39.641048 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ff64b9ef40408aaa1f8860bbd16b5f', 'request_id': 'req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:39.647222 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ff64b9ef40408aaa1f8860bbd16b5f', 'request_id': 'req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:39.737305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] The token cache is being invalidate because project 98ff64b9ef40408aaa1f8860bbd16b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 21:59:39.737644 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:39.738247 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b0f646dd-98da-49b9-a8a4-80c69e7ecf02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 21:59:39.739820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1192/2437] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 21:59:39 2022] DELETE /identity/v3/projects/98ff64b9ef40408aaa1f8860bbd16b5f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:59:39.744668 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32864-1e15-4058-a99a-441f6cfb7f86 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:39.745165 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32864-1e15-4058-a99a-441f6cfb7f86 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:39.745275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d32864-1e15-4058-a99a-441f6cfb7f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:39.764183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-57d32864-1e15-4058-a99a-441f6cfb7f86 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:39.765465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-57d32864-1e15-4058-a99a-441f6cfb7f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:39.832596 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1246/2438] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:39.834691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d195ca-a985-450f-ad9e-f6cced77501f None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:39.835055 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d195ca-a985-450f-ad9e-f6cced77501f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:39.835400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d195ca-a985-450f-ad9e-f6cced77501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:39.855579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a7d195ca-a985-450f-ad9e-f6cced77501f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:39.857562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a7d195ca-a985-450f-ad9e-f6cced77501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:39.866886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1193/2439] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:39.875676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d32864-1e15-4058-a99a-441f6cfb7f86 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:39.885812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d32864-1e15-4058-a99a-441f6cfb7f86 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:39.891065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec99091-e054-4221-8cbc-e3094e4e561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:39.891748 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec99091-e054-4221-8cbc-e3094e4e561c admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:39.892028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec99091-e054-4221-8cbc-e3094e4e561c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:39.892300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec99091-e054-4221-8cbc-e3094e4e561c admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:39.893025 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec99091-e054-4221-8cbc-e3094e4e561c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 21:59:39.893329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec99091-e054-4221-8cbc-e3094e4e561c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:39.894967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec99091-e054-4221-8cbc-e3094e4e561c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:39.907091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1247/2440] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 21:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 21:59:39.911691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d195ca-a985-450f-ad9e-f6cced77501f None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:39.922677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d195ca-a985-450f-ad9e-f6cced77501f None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:39.927726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24dddb-590a-46c9-8c47-6d7380120ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:39.929308 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24dddb-590a-46c9-8c47-6d7380120ffd admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:39.929764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24dddb-590a-46c9-8c47-6d7380120ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:39.930107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24dddb-590a-46c9-8c47-6d7380120ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:39.931018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24dddb-590a-46c9-8c47-6d7380120ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:39.933069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f24dddb-590a-46c9-8c47-6d7380120ffd admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:40.213815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1194/2441] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 21:59:39 2022] POST /identity/v3/projects => generated 377 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:59:40.219044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec99091-e054-4221-8cbc-e3094e4e561c admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:40.229019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec99091-e054-4221-8cbc-e3094e4e561c admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:40.287265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2d778-360a-4d5c-a3a8-6d866b0310fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:40.287946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2d778-360a-4d5c-a3a8-6d866b0310fd admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:40.288224 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2d778-360a-4d5c-a3a8-6d866b0310fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:40.288494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2d778-360a-4d5c-a3a8-6d866b0310fd admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:40.289174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2d778-360a-4d5c-a3a8-6d866b0310fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:40.291158 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2d778-360a-4d5c-a3a8-6d866b0310fd admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:40.419449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1248/2442] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 21:59:40 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 21:59:40.424792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24dddb-590a-46c9-8c47-6d7380120ffd admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:40.435676 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24dddb-590a-46c9-8c47-6d7380120ffd admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:40.440237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e977c-ed1e-479d-b0c3-ad17d694b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:40.440921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e977c-ed1e-479d-b0c3-ad17d694b750 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:40.441255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e977c-ed1e-479d-b0c3-ad17d694b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:40.441598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e977c-ed1e-479d-b0c3-ad17d694b750 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:40.442433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e977c-ed1e-479d-b0c3-ad17d694b750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:40.444078 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e977c-ed1e-479d-b0c3-ad17d694b750 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:40.458835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1195/2443] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 21:59:40.463218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2d778-360a-4d5c-a3a8-6d866b0310fd admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:40.473524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2d778-360a-4d5c-a3a8-6d866b0310fd admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:40.478422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846008f3-5e13-4bc7-842a-46f3cda68366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:40.479166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846008f3-5e13-4bc7-842a-46f3cda68366 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:40.479450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846008f3-5e13-4bc7-842a-46f3cda68366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:40.479725 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846008f3-5e13-4bc7-842a-46f3cda68366 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:40.480451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846008f3-5e13-4bc7-842a-46f3cda68366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:40.482124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846008f3-5e13-4bc7-842a-46f3cda68366 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:40.492431 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1249/2444] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 21:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 21:59:40.500235 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e977c-ed1e-479d-b0c3-ad17d694b750 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:40.511005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e977c-ed1e-479d-b0c3-ad17d694b750 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:40.516512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130451f-6898-4c70-b63c-c26fddb12551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:40.517381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130451f-6898-4c70-b63c-c26fddb12551 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:40.518126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130451f-6898-4c70-b63c-c26fddb12551 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:40.518126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130451f-6898-4c70-b63c-c26fddb12551 admin admin] PATH_INFO: `/v3/projects/4e415d1871af4d26a84530ed592e1239/users/17cf385903a84e948fe861dc616746ae/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:40.534000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130451f-6898-4c70-b63c-c26fddb12551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e415d1871af4d26a84530ed592e1239, user_id=17cf385903a84e948fe861dc616746ae, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:40.536739 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130451f-6898-4c70-b63c-c26fddb12551 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:40.677037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1196/2445] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 21:59:40 2022] PUT /identity/v3/projects/4e415d1871af4d26a84530ed592e1239/users/17cf385903a84e948fe861dc616746ae/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 21:59:40.682202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859bc1-6b93-4840-b4a4-dce5b5f05b53 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:40.682494 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859bc1-6b93-4840-b4a4-dce5b5f05b53 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:40.682768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859bc1-6b93-4840-b4a4-dce5b5f05b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:40.701740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-51859bc1-6b93-4840-b4a4-dce5b5f05b53 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:40.707404 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-51859bc1-6b93-4840-b4a4-dce5b5f05b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:40.764945 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1250/2446] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:40.779027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130451f-6898-4c70-b63c-c26fddb12551 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:40.780771 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7130451f-6898-4c70-b63c-c26fddb12551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:40.839970 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130451f-6898-4c70-b63c-c26fddb12551 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:40.845261 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a9711-6498-4257-a911-51db5fcfdb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:40.845926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9711-6498-4257-a911-51db5fcfdb4e service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:40.846237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9711-6498-4257-a911-51db5fcfdb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:40.846512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9711-6498-4257-a911-51db5fcfdb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:40.857482 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a9711-6498-4257-a911-51db5fcfdb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:40.859041 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a9711-6498-4257-a911-51db5fcfdb4e service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:40.869171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1197/2447] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:59:46.280257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dbfda-cfec-494f-97a6-eccd911403b6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:46.280769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dbfda-cfec-494f-97a6-eccd911403b6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:46.280888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dbfda-cfec-494f-97a6-eccd911403b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:46.298958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-5a3dbfda-cfec-494f-97a6-eccd911403b6 None None] MFA Rules not processed for user `457b1e5c52e5439981bb01b3ecabf9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:46.301190 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5a3dbfda-cfec-494f-97a6-eccd911403b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:46.376709 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1251/2448] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:47.979331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78a51e-6519-418d-a363-be4dc057a5fc None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:47.979809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78a51e-6519-418d-a363-be4dc057a5fc None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:47.983690 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78a51e-6519-418d-a363-be4dc057a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:48.018909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-eb78a51e-6519-418d-a363-be4dc057a5fc None None] MFA Rules not processed for user `17cf385903a84e948fe861dc616746ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:48.020257 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-eb78a51e-6519-418d-a363-be4dc057a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:48.099476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1198/2449] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:48.111523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dbfda-cfec-494f-97a6-eccd911403b6 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:48.113093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5a3dbfda-cfec-494f-97a6-eccd911403b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:48.230129 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dbfda-cfec-494f-97a6-eccd911403b6 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:48.237649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6c02a-8852-4650-9386-69e55f25b24c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:48.238619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c02a-8852-4650-9386-69e55f25b24c service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:48.238865 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c02a-8852-4650-9386-69e55f25b24c service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:48.239163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6c02a-8852-4650-9386-69e55f25b24c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:48.248444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6c02a-8852-4650-9386-69e55f25b24c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:48.250131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6c02a-8852-4650-9386-69e55f25b24c service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:48.259034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1252/2450] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 21:59:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 21:59:51.457392 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f7f0-677b-4315-9d09-580bf6e68da5 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:51.458309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f7f0-677b-4315-9d09-580bf6e68da5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:51.458744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166f7f0-677b-4315-9d09-580bf6e68da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:51.482752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-2166f7f0-677b-4315-9d09-580bf6e68da5 None None] MFA Rules not processed for user `17cf385903a84e948fe861dc616746ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:51.484318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2166f7f0-677b-4315-9d09-580bf6e68da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:51.492437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1199/2451] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 21:59:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:56.359067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb7406-d218-4bfc-9092-58233f5f98f6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:56.359660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb7406-d218-4bfc-9092-58233f5f98f6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:56.360767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb7406-d218-4bfc-9092-58233f5f98f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:56.420848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-f0cb7406-d218-4bfc-9092-58233f5f98f6 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 21:59:56.421972 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f0cb7406-d218-4bfc-9092-58233f5f98f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:56.486912 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1253/2452] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 21:59:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 21:59:56.530226 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166f7f0-677b-4315-9d09-580bf6e68da5 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 21:59:56.531634 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2166f7f0-677b-4315-9d09-580bf6e68da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 21:59:56.624904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166f7f0-677b-4315-9d09-580bf6e68da5 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 21:59:56.630726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3508e-9e62-4a85-b5af-51409a75b3c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 21:59:56.631378 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3508e-9e62-4a85-b5af-51409a75b3c3 service swift] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 21:59:56.631661 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3508e-9e62-4a85-b5af-51409a75b3c3 service swift] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 21:59:56.631937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3508e-9e62-4a85-b5af-51409a75b3c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 21:59:56.641442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3508e-9e62-4a85-b5af-51409a75b3c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 21:59:56.643099 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3508e-9e62-4a85-b5af-51409a75b3c3 service swift] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 21:59:56.651500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1200/2453] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 21:59:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:00:06.451225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb7406-d218-4bfc-9092-58233f5f98f6 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:06.453289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f0cb7406-d218-4bfc-9092-58233f5f98f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:06.468522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb7406-d218-4bfc-9092-58233f5f98f6 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:06.475695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:06.476711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:06.477017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:06.477374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] PATH_INFO: `/v3/users/9af9a951071d44488fc3bf58246088fb` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:06.478779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af9a951071d44488fc3bf58246088fb)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:06.481551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:06.735872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af9a951071d44488fc3bf58246088fb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:06.754790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af9a951071d44488fc3bf58246088fb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:06.854347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af9a951071d44488fc3bf58246088fb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:06.875000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af9a951071d44488fc3bf58246088fb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:06.876066 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af9a951071d44488fc3bf58246088fb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:06.885128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1254/2454] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:00:06 2022] DELETE /identity/v3/users/9af9a951071d44488fc3bf58246088fb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:00:06.889840 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09089a96-5d27-4956-994c-500e604c23eb None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:06.890430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09089a96-5d27-4956-994c-500e604c23eb None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:06.890430 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09089a96-5d27-4956-994c-500e604c23eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:06.912682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-09089a96-5d27-4956-994c-500e604c23eb None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:06.914291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-09089a96-5d27-4956-994c-500e604c23eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:07.027207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1201/2455] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:07.036237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:07.037944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:07.143937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4c284-8d11-4517-a5f7-c7189cdd848f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:07.148560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edead59-2e26-4bbd-b942-332f27d45f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:07.149496 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edead59-2e26-4bbd-b942-332f27d45f28 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:07.149931 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edead59-2e26-4bbd-b942-332f27d45f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:07.150382 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edead59-2e26-4bbd-b942-332f27d45f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:07.163684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edead59-2e26-4bbd-b942-332f27d45f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:07.165250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edead59-2e26-4bbd-b942-332f27d45f28 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:07.222684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1255/2456] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:00:08.578800 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09089a96-5d27-4956-994c-500e604c23eb None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:08.580504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-09089a96-5d27-4956-994c-500e604c23eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:08.603695 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09089a96-5d27-4956-994c-500e604c23eb None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:08.612171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:08.613753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:08.614201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:08.615225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] PATH_INFO: `/v3/projects/c2cf6ce6c6054c83aa7f4ad7fd703a7a` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:08.636749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2cf6ce6c6054c83aa7f4ad7fd703a7a)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:08.636749 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:08.833219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2cf6ce6c6054c83aa7f4ad7fd703a7a', 'request_id': 'req-e466a515-50ff-4068-865a-38e6086081e4'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:08.843370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2cf6ce6c6054c83aa7f4ad7fd703a7a', 'request_id': 'req-e466a515-50ff-4068-865a-38e6086081e4'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:08.859293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2cf6ce6c6054c83aa7f4ad7fd703a7a', 'request_id': 'req-e466a515-50ff-4068-865a-38e6086081e4'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:09.000412 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] The token cache is being invalidate because project c2cf6ce6c6054c83aa7f4ad7fd703a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:00:09.001117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:09.002455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-e466a515-50ff-4068-865a-38e6086081e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:09.018476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1202/2457] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:00:08 2022] DELETE /identity/v3/projects/c2cf6ce6c6054c83aa7f4ad7fd703a7a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:00:09.020295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d2875-380d-488a-acbe-1647c00f6a52 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:09.021602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d2875-380d-488a-acbe-1647c00f6a52 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:09.022061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d2875-380d-488a-acbe-1647c00f6a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:09.044854 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-012d2875-380d-488a-acbe-1647c00f6a52 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:09.046398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-012d2875-380d-488a-acbe-1647c00f6a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:09.127747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1256/2458] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:09.136798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d639b-3f1a-45a8-aeac-c1029bc547cd None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:09.137113 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d639b-3f1a-45a8-aeac-c1029bc547cd None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:09.137395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d639b-3f1a-45a8-aeac-c1029bc547cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:09.156434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9f7d639b-3f1a-45a8-aeac-c1029bc547cd None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:09.157655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9f7d639b-3f1a-45a8-aeac-c1029bc547cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:09.169594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1203/2459] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:09.173653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d2875-380d-488a-acbe-1647c00f6a52 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:09.188270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d2875-380d-488a-acbe-1647c00f6a52 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:09.193663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b0ae4-dffe-42e1-b58e-a32c9849c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:09.194352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b0ae4-dffe-42e1-b58e-a32c9849c3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:09.194755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b0ae4-dffe-42e1-b58e-a32c9849c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:09.195037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b0ae4-dffe-42e1-b58e-a32c9849c3e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:09.195757 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b0ae4-dffe-42e1-b58e-a32c9849c3e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:00:09.196058 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b0ae4-dffe-42e1-b58e-a32c9849c3e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:09.197632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b0ae4-dffe-42e1-b58e-a32c9849c3e5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:09.211634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1257/2460] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:00:09.222297 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d639b-3f1a-45a8-aeac-c1029bc547cd None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:09.232784 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d639b-3f1a-45a8-aeac-c1029bc547cd None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:09.238344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51d4a5-8aac-41bc-8410-7623743e7940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:09.239026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51d4a5-8aac-41bc-8410-7623743e7940 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:09.239309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51d4a5-8aac-41bc-8410-7623743e7940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:09.239582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51d4a5-8aac-41bc-8410-7623743e7940 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:09.240288 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51d4a5-8aac-41bc-8410-7623743e7940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:09.242265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51d4a5-8aac-41bc-8410-7623743e7940 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:09.418972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1204/2461] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:00:09 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:00:09.423196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b0ae4-dffe-42e1-b58e-a32c9849c3e5 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:09.440119 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b0ae4-dffe-42e1-b58e-a32c9849c3e5 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:09.540177 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604bf51-22d5-44bf-82e3-0face29ebf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:09.541354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604bf51-22d5-44bf-82e3-0face29ebf81 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:09.541972 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604bf51-22d5-44bf-82e3-0face29ebf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:09.542515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604bf51-22d5-44bf-82e3-0face29ebf81 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:09.544032 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604bf51-22d5-44bf-82e3-0face29ebf81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:09.546353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604bf51-22d5-44bf-82e3-0face29ebf81 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:09.740304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1258/2462] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:00:09 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:00:09.744533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51d4a5-8aac-41bc-8410-7623743e7940 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:09.786525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51d4a5-8aac-41bc-8410-7623743e7940 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:09.796459 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dec57-1be5-48dd-b3a7-d68a5c0b2508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:09.797151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dec57-1be5-48dd-b3a7-d68a5c0b2508 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:09.797438 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dec57-1be5-48dd-b3a7-d68a5c0b2508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:09.797715 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dec57-1be5-48dd-b3a7-d68a5c0b2508 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:09.798486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dec57-1be5-48dd-b3a7-d68a5c0b2508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:09.801698 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dec57-1be5-48dd-b3a7-d68a5c0b2508 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:09.823239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1205/2463] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:00:09.828260 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604bf51-22d5-44bf-82e3-0face29ebf81 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:09.838611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604bf51-22d5-44bf-82e3-0face29ebf81 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:09.847019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802f5af-6160-4f84-ade6-528db8861935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:09.847019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802f5af-6160-4f84-ade6-528db8861935 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:09.847019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802f5af-6160-4f84-ade6-528db8861935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:09.847019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802f5af-6160-4f84-ade6-528db8861935 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:09.847375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802f5af-6160-4f84-ade6-528db8861935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:09.848545 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802f5af-6160-4f84-ade6-528db8861935 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:09.864528 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1259/2464] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:00:09.865683 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dec57-1be5-48dd-b3a7-d68a5c0b2508 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:09.884020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dec57-1be5-48dd-b3a7-d68a5c0b2508 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:09.889912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0138d-9189-428a-9a7c-472db582dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:09.891395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0138d-9189-428a-9a7c-472db582dab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:09.891944 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0138d-9189-428a-9a7c-472db582dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:09.892520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0138d-9189-428a-9a7c-472db582dab6 admin admin] PATH_INFO: `/v3/projects/41fad17e39fc4970a4688f9d08a37877/users/7c2b6f493a8146969afc9820f2f1a8ae/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:09.911791 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0138d-9189-428a-9a7c-472db582dab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41fad17e39fc4970a4688f9d08a37877, user_id=7c2b6f493a8146969afc9820f2f1a8ae, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:09.916037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0138d-9189-428a-9a7c-472db582dab6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:09.988373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1206/2465] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:00:09 2022] PUT /identity/v3/projects/41fad17e39fc4970a4688f9d08a37877/users/7c2b6f493a8146969afc9820f2f1a8ae/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:00:09.993481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978869e-f967-4ea8-a786-749b9758784a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:09.993842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978869e-f967-4ea8-a786-749b9758784a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:09.994221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978869e-f967-4ea8-a786-749b9758784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:10.012769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-b978869e-f967-4ea8-a786-749b9758784a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:10.014072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-b978869e-f967-4ea8-a786-749b9758784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:10.079198 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1260/2466] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:10.088728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0138d-9189-428a-9a7c-472db582dab6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:10.092300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-59f0138d-9189-428a-9a7c-472db582dab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:10.152702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0138d-9189-428a-9a7c-472db582dab6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:10.156284 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd575102-3a80-4acd-be15-afd0500c2858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:10.156997 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575102-3a80-4acd-be15-afd0500c2858 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:10.157343 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575102-3a80-4acd-be15-afd0500c2858 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:10.157688 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd575102-3a80-4acd-be15-afd0500c2858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:10.167473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd575102-3a80-4acd-be15-afd0500c2858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:10.168910 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd575102-3a80-4acd-be15-afd0500c2858 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:10.180040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1207/2467] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 22:00:15.675402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857e88-9296-456b-be41-c8f86ba37da5 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:15.676438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857e88-9296-456b-be41-c8f86ba37da5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:15.676864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857e88-9296-456b-be41-c8f86ba37da5 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:15.680627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1261/2468] 10.222.0.26 () {54 vars in 921 bytes} [Mon Feb 28 22:00:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 28 22:00:15.694471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe265e-4b50-4903-b7e2-d1d82d2c31c7 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:15.694954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe265e-4b50-4903-b7e2-d1d82d2c31c7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:15.695064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe265e-4b50-4903-b7e2-d1d82d2c31c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:15.781348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9fbe265e-4b50-4903-b7e2-d1d82d2c31c7 None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:15.782638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9fbe265e-4b50-4903-b7e2-d1d82d2c31c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:15.909039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1208/2469] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Feb 28 22:00:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:15.924633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857e88-9296-456b-be41-c8f86ba37da5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:15.926537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0b857e88-9296-456b-be41-c8f86ba37da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:15.983178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063462-0062-4484-86d6-daeb73a5eef6 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:15.983622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063462-0062-4484-86d6-daeb73a5eef6 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:15.983736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063462-0062-4484-86d6-daeb73a5eef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.021385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-16063462-0062-4484-86d6-daeb73a5eef6 None None] MFA Rules not processed for user `7c2b6f493a8146969afc9820f2f1a8ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:16.022709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-16063462-0062-4484-86d6-daeb73a5eef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:16.036779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857e88-9296-456b-be41-c8f86ba37da5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:16.040978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd54ff-05fe-487d-bc56-e0a79ff55d4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500eaf6aadff441ca1e535443e1d8c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:16.047540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd54ff-05fe-487d-bc56-e0a79ff55d4b service glance] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.047540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd54ff-05fe-487d-bc56-e0a79ff55d4b service glance] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.047540 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd54ff-05fe-487d-bc56-e0a79ff55d4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.054132 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd54ff-05fe-487d-bc56-e0a79ff55d4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:16.055706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd54ff-05fe-487d-bc56-e0a79ff55d4b service glance] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:16.073429 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1262/2470] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:00:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:00:16.122164 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1209/2471] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:16.126387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd54ff-05fe-487d-bc56-e0a79ff55d4b service glance] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:16.137810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd54ff-05fe-487d-bc56-e0a79ff55d4b service glance] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:16.144803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f3407-c2c0-4c28-95b6-f9019878d06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:16.147049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f3407-c2c0-4c28-95b6-f9019878d06b admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.147333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f3407-c2c0-4c28-95b6-f9019878d06b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.147610 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f3407-c2c0-4c28-95b6-f9019878d06b admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.148323 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f3407-c2c0-4c28-95b6-f9019878d06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:16.154708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f3407-c2c0-4c28-95b6-f9019878d06b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:16.391455 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1263/2472] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:00:16 2022] POST /identity/v3/projects => generated 373 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:00:16.395765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16063462-0062-4484-86d6-daeb73a5eef6 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:16.407061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16063462-0062-4484-86d6-daeb73a5eef6 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:16.439254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb75dc-8de9-490d-9b46-4662da361cff None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.439660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb75dc-8de9-490d-9b46-4662da361cff None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.440040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb75dc-8de9-490d-9b46-4662da361cff None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.442211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1264/2473] 10.222.0.26 () {54 vars in 921 bytes} [Mon Feb 28 22:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 22:00:16.447284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac1f07-ef39-42e7-8e86-33ae5b79e6f6 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.447565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac1f07-ef39-42e7-8e86-33ae5b79e6f6 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.447843 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac1f07-ef39-42e7-8e86-33ae5b79e6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.468174 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-f5ac1f07-ef39-42e7-8e86-33ae5b79e6f6 None None] MFA Rules not processed for user `b4664710493b462bafae3908c582e9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:16.469348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f5ac1f07-ef39-42e7-8e86-33ae5b79e6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:16.469808 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bfc83-0b89-4661-9b11-8f792589bca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:16.470633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bfc83-0b89-4661-9b11-8f792589bca1 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.471022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bfc83-0b89-4661-9b11-8f792589bca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.471393 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bfc83-0b89-4661-9b11-8f792589bca1 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.472178 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bfc83-0b89-4661-9b11-8f792589bca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:16.474547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bfc83-0b89-4661-9b11-8f792589bca1 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:16.524603 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1265/2474] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Feb 28 22:00:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:00:16.538405 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac1f07-ef39-42e7-8e86-33ae5b79e6f6 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:16.548021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac1f07-ef39-42e7-8e86-33ae5b79e6f6 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:16.551825 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a87d0e-3a05-4684-86a2-afbdb7385b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:16.552471 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87d0e-3a05-4684-86a2-afbdb7385b9d service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.552750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87d0e-3a05-4684-86a2-afbdb7385b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.553051 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87d0e-3a05-4684-86a2-afbdb7385b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.562062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a87d0e-3a05-4684-86a2-afbdb7385b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:16.564156 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a87d0e-3a05-4684-86a2-afbdb7385b9d service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:16.572264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1266/2475] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:00:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 22:00:16.597318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1210/2476] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:00:16 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:00:16.601497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a87d0e-3a05-4684-86a2-afbdb7385b9d service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:16.613862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a87d0e-3a05-4684-86a2-afbdb7385b9d service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:16.618848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35b831-28b7-4c78-b088-ce28275fda18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:16.619611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b831-28b7-4c78-b088-ce28275fda18 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.619964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b831-28b7-4c78-b088-ce28275fda18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.620310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b831-28b7-4c78-b088-ce28275fda18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.621916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35b831-28b7-4c78-b088-ce28275fda18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:16.624059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35b831-28b7-4c78-b088-ce28275fda18 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:16.638043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1267/2477] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:00:16.642741 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bfc83-0b89-4661-9b11-8f792589bca1 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:16.652702 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bfc83-0b89-4661-9b11-8f792589bca1 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:16.657360 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c9ba-b143-4a2d-9e97-f5a1ff35a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:16.658271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c9ba-b143-4a2d-9e97-f5a1ff35a958 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.658548 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c9ba-b143-4a2d-9e97-f5a1ff35a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.659272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383c9ba-b143-4a2d-9e97-f5a1ff35a958 admin admin] PATH_INFO: `/v3/projects/5c9afa14d6d0454398dd47812852e2a9/users/435d18359e7942c9aeb49ef39635a18e/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.671450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302ddf-f162-49e6-a3a3-06129d827b40 None None] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.672027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302ddf-f162-49e6-a3a3-06129d827b40 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.672318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302ddf-f162-49e6-a3a3-06129d827b40 None None] PATH_INFO: `/` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.675952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1268/2478] 10.222.0.26 () {54 vars in 921 bytes} [Mon Feb 28 22:00:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 28 22:00:16.681373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44726d72-6593-44de-a3fd-76628885898a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.682049 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44726d72-6593-44de-a3fd-76628885898a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.682520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44726d72-6593-44de-a3fd-76628885898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.682649 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383c9ba-b143-4a2d-9e97-f5a1ff35a958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9afa14d6d0454398dd47812852e2a9, user_id=435d18359e7942c9aeb49ef39635a18e, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:16.686017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383c9ba-b143-4a2d-9e97-f5a1ff35a958 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:16.704967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-44726d72-6593-44de-a3fd-76628885898a None None] MFA Rules not processed for user `8182c282a5754f05b4bb6bb7057fa7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:16.706248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-44726d72-6593-44de-a3fd-76628885898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:16.779241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1269/2479] 10.222.0.26 () {58 vars in 1018 bytes} [Mon Feb 28 22:00:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:16.789787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44726d72-6593-44de-a3fd-76628885898a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:16.800308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44726d72-6593-44de-a3fd-76628885898a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:16.804197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9d0b7-083c-489f-85b1-e84bb84bbbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:16.804833 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9d0b7-083c-489f-85b1-e84bb84bbbcd service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.805115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9d0b7-083c-489f-85b1-e84bb84bbbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.805389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9d0b7-083c-489f-85b1-e84bb84bbbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.817028 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9d0b7-083c-489f-85b1-e84bb84bbbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:16.818522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9d0b7-083c-489f-85b1-e84bb84bbbcd service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:16.820620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1211/2480] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:00:16 2022] PUT /identity/v3/projects/5c9afa14d6d0454398dd47812852e2a9/users/435d18359e7942c9aeb49ef39635a18e/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:00:16.824854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c9ba-b143-4a2d-9e97-f5a1ff35a958 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:16.830705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1270/2481] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:00:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 22:00:16.906978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383c9ba-b143-4a2d-9e97-f5a1ff35a958 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:16.911932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee3159-3efe-4f89-b6ab-31c197129e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:16.912601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee3159-3efe-4f89-b6ab-31c197129e7a admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.912882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee3159-3efe-4f89-b6ab-31c197129e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.913157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee3159-3efe-4f89-b6ab-31c197129e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.913884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee3159-3efe-4f89-b6ab-31c197129e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:16.915726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee3159-3efe-4f89-b6ab-31c197129e7a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:16.929368 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1212/2482] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 22:00:16.931571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9d0b7-083c-489f-85b1-e84bb84bbbcd service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:16.945126 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9d0b7-083c-489f-85b1-e84bb84bbbcd service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:16.951323 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067d59-6953-43d9-aac2-a7d0acb0a9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:16.952288 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067d59-6953-43d9-aac2-a7d0acb0a9a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:16.952657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067d59-6953-43d9-aac2-a7d0acb0a9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:16.953000 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067d59-6953-43d9-aac2-a7d0acb0a9a0 admin admin] PATH_INFO: `/v3/projects/5c9afa14d6d0454398dd47812852e2a9/users/435d18359e7942c9aeb49ef39635a18e/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:16.955299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10067d59-6953-43d9-aac2-a7d0acb0a9a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9afa14d6d0454398dd47812852e2a9, user_id=435d18359e7942c9aeb49ef39635a18e, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:16.958292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10067d59-6953-43d9-aac2-a7d0acb0a9a0 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:16.976462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1271/2483] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:00:16 2022] PUT /identity/v3/projects/5c9afa14d6d0454398dd47812852e2a9/users/435d18359e7942c9aeb49ef39635a18e/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:00:18.238237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1b0c3-8e6c-4546-8f96-8475d72863a6 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:18.239157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1b0c3-8e6c-4546-8f96-8475d72863a6 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:18.239582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1b0c3-8e6c-4546-8f96-8475d72863a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:18.262614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-1cc1b0c3-8e6c-4546-8f96-8475d72863a6 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:18.264302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-1cc1b0c3-8e6c-4546-8f96-8475d72863a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:18.343926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1213/2484] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 22:00:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:18.355185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067d59-6953-43d9-aac2-a7d0acb0a9a0 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:18.357627 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-10067d59-6953-43d9-aac2-a7d0acb0a9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:18.454520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067d59-6953-43d9-aac2-a7d0acb0a9a0 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:18.460044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6619a-a5a1-4eef-ac6b-1ba9f6c00d82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:18.460695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6619a-a5a1-4eef-ac6b-1ba9f6c00d82 service swift] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:18.461018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6619a-a5a1-4eef-ac6b-1ba9f6c00d82 service swift] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:18.461338 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6619a-a5a1-4eef-ac6b-1ba9f6c00d82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:18.470669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6619a-a5a1-4eef-ac6b-1ba9f6c00d82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:18.476163 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6619a-a5a1-4eef-ac6b-1ba9f6c00d82 service swift] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:18.482979 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1272/2485] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:00:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:00:21.416889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54e76c-f410-40da-b1df-da5bb7144ee3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:21.417806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54e76c-f410-40da-b1df-da5bb7144ee3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:21.418117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54e76c-f410-40da-b1df-da5bb7144ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:21.441298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ca54e76c-f410-40da-b1df-da5bb7144ee3 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:21.443332 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ca54e76c-f410-40da-b1df-da5bb7144ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:21.457278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1214/2486] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:21.494757 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6619a-a5a1-4eef-ac6b-1ba9f6c00d82 service swift] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:21.512948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6619a-a5a1-4eef-ac6b-1ba9f6c00d82 service swift] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:21.545791 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c1429-79d1-40ef-bcd7-b823da2a99e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:21.546444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c1429-79d1-40ef-bcd7-b823da2a99e3 service swift] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:21.546731 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c1429-79d1-40ef-bcd7-b823da2a99e3 service swift] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:21.547008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c1429-79d1-40ef-bcd7-b823da2a99e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:21.556997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c1429-79d1-40ef-bcd7-b823da2a99e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:21.563874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c1429-79d1-40ef-bcd7-b823da2a99e3 service swift] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:21.582252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1273/2487] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:00:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:00:26.323638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a615-5c90-483f-9e09-1b9f8ec7a17a None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:26.326231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a615-5c90-483f-9e09-1b9f8ec7a17a None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:26.327154 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a615-5c90-483f-9e09-1b9f8ec7a17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:26.392384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a496a615-5c90-483f-9e09-1b9f8ec7a17a None None] MFA Rules not processed for user `435d18359e7942c9aeb49ef39635a18e`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:26.394075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a496a615-5c90-483f-9e09-1b9f8ec7a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:26.521172 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1215/2488] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:26.535403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c1429-79d1-40ef-bcd7-b823da2a99e3 service swift] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:26.536978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-126c1429-79d1-40ef-bcd7-b823da2a99e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:26.644936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c1429-79d1-40ef-bcd7-b823da2a99e3 service swift] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:26.655256 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7910f-f86b-47d8-a8be-35d9940865ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:26.657971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7910f-f86b-47d8-a8be-35d9940865ad service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:26.658595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7910f-f86b-47d8-a8be-35d9940865ad service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:26.659284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7910f-f86b-47d8-a8be-35d9940865ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:26.742420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7910f-f86b-47d8-a8be-35d9940865ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:26.744692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7910f-f86b-47d8-a8be-35d9940865ad service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:26.767960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1274/2489] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:00:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:00:31.771684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0cacd-6b8f-4d88-82d2-508576675740 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:31.772399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0cacd-6b8f-4d88-82d2-508576675740 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:31.772399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0cacd-6b8f-4d88-82d2-508576675740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:31.799733 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-fde0cacd-6b8f-4d88-82d2-508576675740 None None] MFA Rules not processed for user `7c2b6f493a8146969afc9820f2f1a8ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:31.805830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fde0cacd-6b8f-4d88-82d2-508576675740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:31.822371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1216/2490] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:40.418801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6977f18-877f-404a-83fc-071d8be197a2 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:40.419374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6977f18-877f-404a-83fc-071d8be197a2 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:40.419374 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6977f18-877f-404a-83fc-071d8be197a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:40.437704 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-f6977f18-877f-404a-83fc-071d8be197a2 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:40.438969 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f6977f18-877f-404a-83fc-071d8be197a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:40.446276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1275/2491] 10.222.0.26 () {58 vars in 967 bytes} [Mon Feb 28 22:00:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:40.459185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0cacd-6b8f-4d88-82d2-508576675740 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:40.472251 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0cacd-6b8f-4d88-82d2-508576675740 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:40.477230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045a08-f887-4b3e-ac0f-96c852791da5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:40.477864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045a08-f887-4b3e-ac0f-96c852791da5 service swift] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:40.478189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045a08-f887-4b3e-ac0f-96c852791da5 service swift] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:40.478457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be045a08-f887-4b3e-ac0f-96c852791da5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:40.487686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be045a08-f887-4b3e-ac0f-96c852791da5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:40.489256 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be045a08-f887-4b3e-ac0f-96c852791da5 service swift] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:40.497244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1217/2492] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:00:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:00:43.683306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6977f18-877f-404a-83fc-071d8be197a2 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:43.684761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f6977f18-877f-404a-83fc-071d8be197a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:43.748756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6977f18-877f-404a-83fc-071d8be197a2 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:43.753279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:43.754167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:43.754448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:43.754723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] PATH_INFO: `/v3/users/457b1e5c52e5439981bb01b3ecabf9d0` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:43.755907 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=457b1e5c52e5439981bb01b3ecabf9d0)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:43.757829 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:43.940790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457b1e5c52e5439981bb01b3ecabf9d0'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:43.947420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457b1e5c52e5439981bb01b3ecabf9d0'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:44.035571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457b1e5c52e5439981bb01b3ecabf9d0'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:44.048513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457b1e5c52e5439981bb01b3ecabf9d0'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:44.049173 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-0fa6528b-d39f-4f61-adc3-18062782de3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457b1e5c52e5439981bb01b3ecabf9d0'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:44.058279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1276/2493] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:00:43 2022] DELETE /identity/v3/users/457b1e5c52e5439981bb01b3ecabf9d0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:00:44.380211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045a08-f887-4b3e-ac0f-96c852791da5 service swift] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:44.390857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be045a08-f887-4b3e-ac0f-96c852791da5 service swift] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:44.446546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:44.447486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:44.447716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:44.448018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] PATH_INFO: `/v3/projects/c4acca99140647f0b63399d2c4bc095e` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:44.449225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4acca99140647f0b63399d2c4bc095e)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:44.451418 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:44.566295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4acca99140647f0b63399d2c4bc095e', 'request_id': 'req-fc0989ed-cb6b-4577-a14a-a04cd90e7904'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:44.572344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4acca99140647f0b63399d2c4bc095e', 'request_id': 'req-fc0989ed-cb6b-4577-a14a-a04cd90e7904'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:44.578153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4acca99140647f0b63399d2c4bc095e', 'request_id': 'req-fc0989ed-cb6b-4577-a14a-a04cd90e7904'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:44.667745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] The token cache is being invalidate because project c4acca99140647f0b63399d2c4bc095e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:00:44.668163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:44.668824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-fc0989ed-cb6b-4577-a14a-a04cd90e7904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:00:44.670383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1218/2494] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:00:44 2022] DELETE /identity/v3/projects/c4acca99140647f0b63399d2c4bc095e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:00:44.675418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b8987-a50c-4db4-b4c2-85c9f0f90c4f None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:44.675785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b8987-a50c-4db4-b4c2-85c9f0f90c4f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:44.676061 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b8987-a50c-4db4-b4c2-85c9f0f90c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:44.693503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-6a1b8987-a50c-4db4-b4c2-85c9f0f90c4f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:44.694778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-6a1b8987-a50c-4db4-b4c2-85c9f0f90c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:44.754527 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1277/2495] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:44.762256 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa677c-9b3b-4310-b2fa-e59027f3235d None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:44.764019 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa677c-9b3b-4310-b2fa-e59027f3235d None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:44.764019 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa677c-9b3b-4310-b2fa-e59027f3235d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:44.782852 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-56aa677c-9b3b-4310-b2fa-e59027f3235d None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:44.784043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-56aa677c-9b3b-4310-b2fa-e59027f3235d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:44.791874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1219/2496] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:44.796426 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b8987-a50c-4db4-b4c2-85c9f0f90c4f None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:44.805953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b8987-a50c-4db4-b4c2-85c9f0f90c4f None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:44.810598 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31f1cb-2eee-4273-8b15-37bc09cb57ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:44.811261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f1cb-2eee-4273-8b15-37bc09cb57ea admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:44.811542 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f1cb-2eee-4273-8b15-37bc09cb57ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:44.811815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31f1cb-2eee-4273-8b15-37bc09cb57ea admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:44.812531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31f1cb-2eee-4273-8b15-37bc09cb57ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:00:44.812836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31f1cb-2eee-4273-8b15-37bc09cb57ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:44.814460 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31f1cb-2eee-4273-8b15-37bc09cb57ea admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:44.826251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1278/2497] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 22:00:44.831008 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa677c-9b3b-4310-b2fa-e59027f3235d None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:44.840204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa677c-9b3b-4310-b2fa-e59027f3235d None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:44.845679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c4c2a-59d7-4c79-a053-400a1351a563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:44.846354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c4c2a-59d7-4c79-a053-400a1351a563 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:44.846633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c4c2a-59d7-4c79-a053-400a1351a563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:44.846933 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c4c2a-59d7-4c79-a053-400a1351a563 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:44.847614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c4c2a-59d7-4c79-a053-400a1351a563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:44.849498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c4c2a-59d7-4c79-a053-400a1351a563 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:44.922968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1220/2498] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:00:44 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:00:44.927280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31f1cb-2eee-4273-8b15-37bc09cb57ea admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:44.937608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31f1cb-2eee-4273-8b15-37bc09cb57ea admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:44.991281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1b91-d5b6-4964-85c1-10547a20d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:44.991938 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1b91-d5b6-4964-85c1-10547a20d5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:44.992216 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1b91-d5b6-4964-85c1-10547a20d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:44.992487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1b91-d5b6-4964-85c1-10547a20d5a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:44.993173 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1b91-d5b6-4964-85c1-10547a20d5a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:44.995133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1b91-d5b6-4964-85c1-10547a20d5a1 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:45.069720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1279/2499] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:00:44 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:00:45.079815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c4c2a-59d7-4c79-a053-400a1351a563 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:45.090724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c4c2a-59d7-4c79-a053-400a1351a563 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:45.095339 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2665ac-38be-4262-9a04-20942c5c0b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:45.095984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2665ac-38be-4262-9a04-20942c5c0b66 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:45.096262 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2665ac-38be-4262-9a04-20942c5c0b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:45.096533 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2665ac-38be-4262-9a04-20942c5c0b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:45.097247 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2665ac-38be-4262-9a04-20942c5c0b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:45.098872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2665ac-38be-4262-9a04-20942c5c0b66 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:45.109550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1221/2500] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:00:45.113532 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1b91-d5b6-4964-85c1-10547a20d5a1 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:45.125585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1b91-d5b6-4964-85c1-10547a20d5a1 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:45.130585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca45ca0-d887-4db4-a3e0-d3560a819eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:45.131273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca45ca0-d887-4db4-a3e0-d3560a819eef admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:45.131553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca45ca0-d887-4db4-a3e0-d3560a819eef admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:45.131853 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca45ca0-d887-4db4-a3e0-d3560a819eef admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:45.132566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca45ca0-d887-4db4-a3e0-d3560a819eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:45.137523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca45ca0-d887-4db4-a3e0-d3560a819eef admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:45.149042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1280/2501] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:00:45.153187 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2665ac-38be-4262-9a04-20942c5c0b66 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:45.163207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2665ac-38be-4262-9a04-20942c5c0b66 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:45.168011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b6474-19a1-4f23-9b68-bb2121730d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:45.168879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b6474-19a1-4f23-9b68-bb2121730d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:45.169182 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b6474-19a1-4f23-9b68-bb2121730d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:45.169449 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b6474-19a1-4f23-9b68-bb2121730d91 admin admin] PATH_INFO: `/v3/projects/bc0c18f4d6ce4a21ba84b7f544ea90b7/users/02109279bdf1443d89eb8c219a967ba8/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:45.184331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b6474-19a1-4f23-9b68-bb2121730d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0c18f4d6ce4a21ba84b7f544ea90b7, user_id=02109279bdf1443d89eb8c219a967ba8, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:45.187493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b6474-19a1-4f23-9b68-bb2121730d91 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:45.258080 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1222/2502] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:00:45 2022] PUT /identity/v3/projects/bc0c18f4d6ce4a21ba84b7f544ea90b7/users/02109279bdf1443d89eb8c219a967ba8/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:00:45.263726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac947-44e0-42e4-8166-119e5556374e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:45.264024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac947-44e0-42e4-8166-119e5556374e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:45.264479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dac947-44e0-42e4-8166-119e5556374e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:45.281896 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-46dac947-44e0-42e4-8166-119e5556374e None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:45.283118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-46dac947-44e0-42e4-8166-119e5556374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:45.339493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1281/2503] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:45.349287 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b6474-19a1-4f23-9b68-bb2121730d91 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:45.351023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-111b6474-19a1-4f23-9b68-bb2121730d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:45.408512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b6474-19a1-4f23-9b68-bb2121730d91 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:45.412874 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675fff3-8837-453d-9b9b-9ca37270b62a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:45.413580 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675fff3-8837-453d-9b9b-9ca37270b62a service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:45.413932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675fff3-8837-453d-9b9b-9ca37270b62a service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:45.414271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675fff3-8837-453d-9b9b-9ca37270b62a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:45.430813 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675fff3-8837-453d-9b9b-9ca37270b62a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:45.432380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675fff3-8837-453d-9b9b-9ca37270b62a service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:45.443968 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1223/2504] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:00:51.439618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34643d6-44a9-4db1-b556-0d09226ba8e2 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:51.440085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34643d6-44a9-4db1-b556-0d09226ba8e2 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:51.440306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34643d6-44a9-4db1-b556-0d09226ba8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:51.468648 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d34643d6-44a9-4db1-b556-0d09226ba8e2 None None] MFA Rules not processed for user `02109279bdf1443d89eb8c219a967ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:51.469866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d34643d6-44a9-4db1-b556-0d09226ba8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:51.538088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1282/2505] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:51.542752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675fff3-8837-453d-9b9b-9ca37270b62a service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:51.554197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675fff3-8837-453d-9b9b-9ca37270b62a service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:51.560734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ee90b-fa84-4daf-a56a-4d5d0ddbfd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:51.561408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ee90b-fa84-4daf-a56a-4d5d0ddbfd83 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:51.561684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ee90b-fa84-4daf-a56a-4d5d0ddbfd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:51.562186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ee90b-fa84-4daf-a56a-4d5d0ddbfd83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:51.563040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ee90b-fa84-4daf-a56a-4d5d0ddbfd83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:51.564951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ee90b-fa84-4daf-a56a-4d5d0ddbfd83 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:51.661134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1224/2506] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:00:51 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:00:51.665333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34643d6-44a9-4db1-b556-0d09226ba8e2 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:51.677236 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34643d6-44a9-4db1-b556-0d09226ba8e2 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:51.764339 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fc04c-0701-4d6b-8fc7-7fd5dafbe327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:51.765007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fc04c-0701-4d6b-8fc7-7fd5dafbe327 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:51.765316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fc04c-0701-4d6b-8fc7-7fd5dafbe327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:51.765589 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fc04c-0701-4d6b-8fc7-7fd5dafbe327 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:51.766341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fc04c-0701-4d6b-8fc7-7fd5dafbe327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:51.768254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fc04c-0701-4d6b-8fc7-7fd5dafbe327 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:51.855893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1283/2507] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:00:51 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:00:51.859959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ee90b-fa84-4daf-a56a-4d5d0ddbfd83 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:51.874155 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ee90b-fa84-4daf-a56a-4d5d0ddbfd83 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:51.877647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d2b9-1751-40b3-a36e-f257c940956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:51.878664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d2b9-1751-40b3-a36e-f257c940956f admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:51.879062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d2b9-1751-40b3-a36e-f257c940956f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:51.879489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d2b9-1751-40b3-a36e-f257c940956f admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:51.880425 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018d2b9-1751-40b3-a36e-f257c940956f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:51.882523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018d2b9-1751-40b3-a36e-f257c940956f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:51.895907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1225/2508] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 22:00:51.901441 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fc04c-0701-4d6b-8fc7-7fd5dafbe327 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:51.912178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fc04c-0701-4d6b-8fc7-7fd5dafbe327 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:51.917339 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1860651-1e68-49fc-af70-6ae7fb52093e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:51.918341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860651-1e68-49fc-af70-6ae7fb52093e admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:51.918618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860651-1e68-49fc-af70-6ae7fb52093e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:51.918888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860651-1e68-49fc-af70-6ae7fb52093e admin admin] PATH_INFO: `/v3/projects/6223deacc76b48fd868eb50df1dd3c75/users/e78f56793db846168b4d176398b74eae/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:51.935575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1860651-1e68-49fc-af70-6ae7fb52093e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6223deacc76b48fd868eb50df1dd3c75, user_id=e78f56793db846168b4d176398b74eae, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:51.938561 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1860651-1e68-49fc-af70-6ae7fb52093e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:52.051005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1284/2509] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:00:51 2022] PUT /identity/v3/projects/6223deacc76b48fd868eb50df1dd3c75/users/e78f56793db846168b4d176398b74eae/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:00:52.052268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d2b9-1751-40b3-a36e-f257c940956f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:52.069169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d2b9-1751-40b3-a36e-f257c940956f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:52.135592 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df910a-ce10-43e0-959b-592971caa138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:52.136337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df910a-ce10-43e0-959b-592971caa138 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:52.136729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df910a-ce10-43e0-959b-592971caa138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:52.137108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df910a-ce10-43e0-959b-592971caa138 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:52.138752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df910a-ce10-43e0-959b-592971caa138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:52.139899 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df910a-ce10-43e0-959b-592971caa138 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:52.150987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1226/2510] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:00:52.157349 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1860651-1e68-49fc-af70-6ae7fb52093e admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:52.168074 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1860651-1e68-49fc-af70-6ae7fb52093e admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:52.174018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb24aac-db9f-4e66-a093-739a13f713ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:52.175016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb24aac-db9f-4e66-a093-739a13f713ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:52.175369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb24aac-db9f-4e66-a093-739a13f713ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:52.175710 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb24aac-db9f-4e66-a093-739a13f713ba admin admin] PATH_INFO: `/v3/projects/6223deacc76b48fd868eb50df1dd3c75/users/e78f56793db846168b4d176398b74eae/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:52.177862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb24aac-db9f-4e66-a093-739a13f713ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6223deacc76b48fd868eb50df1dd3c75, user_id=e78f56793db846168b4d176398b74eae, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:52.180690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb24aac-db9f-4e66-a093-739a13f713ba admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:52.192338 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1285/2511] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:00:52 2022] PUT /identity/v3/projects/6223deacc76b48fd868eb50df1dd3c75/users/e78f56793db846168b4d176398b74eae/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:00:52.780121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642bd77-f394-4e80-af40-2e46ef2accb8 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:52.780590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642bd77-f394-4e80-af40-2e46ef2accb8 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:52.780681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642bd77-f394-4e80-af40-2e46ef2accb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:52.801222 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f642bd77-f394-4e80-af40-2e46ef2accb8 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:52.802520 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f642bd77-f394-4e80-af40-2e46ef2accb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:52.881915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1227/2512] 10.222.0.26 () {58 vars in 967 bytes} [Mon Feb 28 22:00:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:52.899348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb24aac-db9f-4e66-a093-739a13f713ba admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:52.901793 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4eb24aac-db9f-4e66-a093-739a13f713ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:52.986706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb24aac-db9f-4e66-a093-739a13f713ba admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:52.992227 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550627be-01f9-4bde-a959-f4a116d3f41b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:52.992971 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550627be-01f9-4bde-a959-f4a116d3f41b service swift] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:52.993315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550627be-01f9-4bde-a959-f4a116d3f41b service swift] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:52.993594 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550627be-01f9-4bde-a959-f4a116d3f41b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:53.003363 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550627be-01f9-4bde-a959-f4a116d3f41b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:53.005601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550627be-01f9-4bde-a959-f4a116d3f41b service swift] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:53.015687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1286/2513] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:00:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:00:57.940005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47535d-1251-44af-bad4-6f887f66a7b1 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:57.940485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47535d-1251-44af-bad4-6f887f66a7b1 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:57.940485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47535d-1251-44af-bad4-6f887f66a7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:57.973061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-dd47535d-1251-44af-bad4-6f887f66a7b1 None None] MFA Rules not processed for user `e78f56793db846168b4d176398b74eae`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:00:57.981240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dd47535d-1251-44af-bad4-6f887f66a7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:58.056437 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1228/2514] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:00:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:00:58.068991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550627be-01f9-4bde-a959-f4a116d3f41b service swift] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:00:58.070962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-550627be-01f9-4bde-a959-f4a116d3f41b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:00:58.152005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550627be-01f9-4bde-a959-f4a116d3f41b service swift] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:00:58.158428 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35861b-6dfd-469d-9dcc-54378a7c620a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:00:58.159077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35861b-6dfd-469d-9dcc-54378a7c620a service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:00:58.159353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35861b-6dfd-469d-9dcc-54378a7c620a service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:00:58.159629 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35861b-6dfd-469d-9dcc-54378a7c620a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:00:58.244536 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35861b-6dfd-469d-9dcc-54378a7c620a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:00:58.246180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35861b-6dfd-469d-9dcc-54378a7c620a service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:00:58.257143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1287/2515] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:00:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:01:02.848244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47535d-1251-44af-bad4-6f887f66a7b1 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:01:02.904031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47535d-1251-44af-bad4-6f887f66a7b1 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:01:02.907912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fd80e-2946-4974-a4b8-79a187130a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:01:02.908559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fd80e-2946-4974-a4b8-79a187130a0e service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:01:02.908839 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fd80e-2946-4974-a4b8-79a187130a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:01:02.909135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fd80e-2946-4974-a4b8-79a187130a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:01:02.910889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ed2fd80e-2946-4974-a4b8-79a187130a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:02.924969 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fd80e-2946-4974-a4b8-79a187130a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:01:02.926475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2fd80e-2946-4974-a4b8-79a187130a0e service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:01:02.938740 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1229/2516] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:01:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:01:04.057084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35861b-6dfd-469d-9dcc-54378a7c620a service nova] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:01:04.071100 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35861b-6dfd-469d-9dcc-54378a7c620a service nova] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:01:04.077244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc05af-c325-4b97-9df0-8dc74636c92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:01:04.078193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc05af-c325-4b97-9df0-8dc74636c92a service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:01:04.078477 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc05af-c325-4b97-9df0-8dc74636c92a service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:01:04.078752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc05af-c325-4b97-9df0-8dc74636c92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:01:04.080837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f0dc05af-c325-4b97-9df0-8dc74636c92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:04.097335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc05af-c325-4b97-9df0-8dc74636c92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:01:04.098845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc05af-c325-4b97-9df0-8dc74636c92a service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:01:04.110699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1288/2517] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:01:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:01:20.972918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fd80e-2946-4974-a4b8-79a187130a0e service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:01:20.974357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ed2fd80e-2946-4974-a4b8-79a187130a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:20.985500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fd80e-2946-4974-a4b8-79a187130a0e service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:01:20.989053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8e0f9-6fb5-4a42-885c-e6e17e62bd75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:01:20.989677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8e0f9-6fb5-4a42-885c-e6e17e62bd75 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:01:20.989951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8e0f9-6fb5-4a42-885c-e6e17e62bd75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:01:20.990253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8e0f9-6fb5-4a42-885c-e6e17e62bd75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:01:20.991914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e5c8e0f9-6fb5-4a42-885c-e6e17e62bd75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:21.053491 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8e0f9-6fb5-4a42-885c-e6e17e62bd75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:01:21.055014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8e0f9-6fb5-4a42-885c-e6e17e62bd75 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:01:21.064940 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1230/2518] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:01:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:01:24.625679 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb097ad2-fd35-4437-aaf6-36089aba2c4e None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:01:24.626291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb097ad2-fd35-4437-aaf6-36089aba2c4e None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:01:24.626291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb097ad2-fd35-4437-aaf6-36089aba2c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:01:24.642886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-cb097ad2-fd35-4437-aaf6-36089aba2c4e None None] MFA Rules not processed for user `02109279bdf1443d89eb8c219a967ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:01:24.644060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-cb097ad2-fd35-4437-aaf6-36089aba2c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:24.651168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1289/2519] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:01:24.959189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8e0f9-6fb5-4a42-885c-e6e17e62bd75 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:01:24.968380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8e0f9-6fb5-4a42-885c-e6e17e62bd75 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:01:24.972147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ed56c-38a7-429a-8ab0-05e88e682745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:01:24.972776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed56c-38a7-429a-8ab0-05e88e682745 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:01:24.973058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed56c-38a7-429a-8ab0-05e88e682745 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:01:24.973333 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ed56c-38a7-429a-8ab0-05e88e682745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:01:24.975130 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-951ed56c-38a7-429a-8ab0-05e88e682745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:24.985602 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ed56c-38a7-429a-8ab0-05e88e682745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:01:24.987163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ed56c-38a7-429a-8ab0-05e88e682745 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:01:24.995365 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1231/2520] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:01:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:01:25.920095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb097ad2-fd35-4437-aaf6-36089aba2c4e None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:01:25.925283 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-cb097ad2-fd35-4437-aaf6-36089aba2c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:25.991907 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb097ad2-fd35-4437-aaf6-36089aba2c4e None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:01:25.997085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08a159-145a-4131-a9d7-b1c7376a730a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1875af7b72b247c9a2b5e1f2b2fb1eaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:01:25.997722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08a159-145a-4131-a9d7-b1c7376a730a service placement] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:01:25.998034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08a159-145a-4131-a9d7-b1c7376a730a service placement] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:01:25.998309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08a159-145a-4131-a9d7-b1c7376a730a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:01:26.000021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ae08a159-145a-4131-a9d7-b1c7376a730a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:26.011116 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08a159-145a-4131-a9d7-b1c7376a730a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:01:26.013345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08a159-145a-4131-a9d7-b1c7376a730a service placement] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:01:26.022928 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1290/2521] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:01:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:01:30.707516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ed56c-38a7-429a-8ab0-05e88e682745 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:01:30.716283 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ed56c-38a7-429a-8ab0-05e88e682745 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:01:30.719879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fce41-70af-41f7-98cd-b4cae36f35f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:01:30.720507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fce41-70af-41f7-98cd-b4cae36f35f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:01:30.720788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fce41-70af-41f7-98cd-b4cae36f35f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:01:30.721067 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fce41-70af-41f7-98cd-b4cae36f35f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:01:30.722838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fe1fce41-70af-41f7-98cd-b4cae36f35f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:30.731930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fce41-70af-41f7-98cd-b4cae36f35f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:01:30.733433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fce41-70af-41f7-98cd-b4cae36f35f9 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:01:30.741163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1232/2522] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:01:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:01:45.995558 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08a159-145a-4131-a9d7-b1c7376a730a service placement] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:01:46.005321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08a159-145a-4131-a9d7-b1c7376a730a service placement] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:01:46.008877 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201ee2b-e1bc-4615-9bfb-b9190f0a337c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:01:46.009499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201ee2b-e1bc-4615-9bfb-b9190f0a337c service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:01:46.009776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201ee2b-e1bc-4615-9bfb-b9190f0a337c service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:01:46.010076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201ee2b-e1bc-4615-9bfb-b9190f0a337c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:01:46.019335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201ee2b-e1bc-4615-9bfb-b9190f0a337c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:01:46.020735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201ee2b-e1bc-4615-9bfb-b9190f0a337c service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:01:46.029707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1291/2523] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:01:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:01:48.170327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fce41-70af-41f7-98cd-b4cae36f35f9 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:01:48.172597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fe1fce41-70af-41f7-98cd-b4cae36f35f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:48.189622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fce41-70af-41f7-98cd-b4cae36f35f9 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:01:48.195568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eda08-917e-488c-a50b-c64a38d7638d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:01:48.196356 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eda08-917e-488c-a50b-c64a38d7638d service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:01:48.196707 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eda08-917e-488c-a50b-c64a38d7638d service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:01:48.197125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85eda08-917e-488c-a50b-c64a38d7638d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:01:48.199236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e85eda08-917e-488c-a50b-c64a38d7638d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:01:48.211992 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85eda08-917e-488c-a50b-c64a38d7638d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:01:48.213599 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85eda08-917e-488c-a50b-c64a38d7638d service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:01:48.224167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1233/2524] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:01:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:02:02.280518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201ee2b-e1bc-4615-9bfb-b9190f0a337c service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:02:02.294489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201ee2b-e1bc-4615-9bfb-b9190f0a337c service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:02:02.299999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126392f-d901-40c2-8f17-915289a7c848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:02:02.300628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126392f-d901-40c2-8f17-915289a7c848 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:02:02.300909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126392f-d901-40c2-8f17-915289a7c848 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:02:02.301183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126392f-d901-40c2-8f17-915289a7c848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:02:02.302951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-6126392f-d901-40c2-8f17-915289a7c848 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:02:02.364909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126392f-d901-40c2-8f17-915289a7c848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:02:02.366722 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126392f-d901-40c2-8f17-915289a7c848 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:02:02.375830 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1292/2525] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:02:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:02:09.012317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eda08-917e-488c-a50b-c64a38d7638d service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:02:09.024733 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85eda08-917e-488c-a50b-c64a38d7638d service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:02:09.030821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527543a-0dba-4eb9-921d-074e1e206bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:02:09.032216 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527543a-0dba-4eb9-921d-074e1e206bc2 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:02:09.032216 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527543a-0dba-4eb9-921d-074e1e206bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:02:09.032490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527543a-0dba-4eb9-921d-074e1e206bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:02:09.034298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5527543a-0dba-4eb9-921d-074e1e206bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:02:09.047196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527543a-0dba-4eb9-921d-074e1e206bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:02:09.048949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527543a-0dba-4eb9-921d-074e1e206bc2 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:02:09.060005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1234/2526] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:02:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:02:14.217754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b17633-054f-484d-83d9-537dfb5ba7cd None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:02:14.219782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b17633-054f-484d-83d9-537dfb5ba7cd None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:02:14.219782 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b17633-054f-484d-83d9-537dfb5ba7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:02:14.237201 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-07b17633-054f-484d-83d9-537dfb5ba7cd None None] MFA Rules not processed for user `b92aaa59fd1747da9626a8173258d194`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:02:14.241385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-07b17633-054f-484d-83d9-537dfb5ba7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:02:14.245501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1293/2527] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:02:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:02:14.560483 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527543a-0dba-4eb9-921d-074e1e206bc2 service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:02:14.570469 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527543a-0dba-4eb9-921d-074e1e206bc2 service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:02:14.574091 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfc2f2-3bd5-4872-a6ef-46699b18a8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:02:14.574737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfc2f2-3bd5-4872-a6ef-46699b18a8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:02:14.575023 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfc2f2-3bd5-4872-a6ef-46699b18a8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:02:14.575302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfc2f2-3bd5-4872-a6ef-46699b18a8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:02:14.577112 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-fadfc2f2-3bd5-4872-a6ef-46699b18a8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:02:14.587179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfc2f2-3bd5-4872-a6ef-46699b18a8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:02:14.588642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfc2f2-3bd5-4872-a6ef-46699b18a8a8 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:02:14.596951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1235/2528] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:02:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:02:24.555238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b17633-054f-484d-83d9-537dfb5ba7cd None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:02:24.568717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b17633-054f-484d-83d9-537dfb5ba7cd None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:02:24.574140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd262efc-c900-4558-ba42-afef05f79ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:02:24.578799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd262efc-c900-4558-ba42-afef05f79ac6 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:02:24.578799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd262efc-c900-4558-ba42-afef05f79ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:02:24.578799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd262efc-c900-4558-ba42-afef05f79ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:02:24.578799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-dd262efc-c900-4558-ba42-afef05f79ac6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:02:24.589701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd262efc-c900-4558-ba42-afef05f79ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:02:24.591388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd262efc-c900-4558-ba42-afef05f79ac6 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:02:24.601538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1294/2529] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:02:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:04:08.222403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb082f-e7b4-490e-8244-6c88fbbac453 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:04:08.222942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb082f-e7b4-490e-8244-6c88fbbac453 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:04:08.223045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb082f-e7b4-490e-8244-6c88fbbac453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:04:08.241814 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-46eb082f-e7b4-490e-8244-6c88fbbac453 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:04:08.244047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-46eb082f-e7b4-490e-8244-6c88fbbac453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:04:08.257668 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1236/2530] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:04:08.418397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd262efc-c900-4558-ba42-afef05f79ac6 service nova] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:04:08.430759 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd262efc-c900-4558-ba42-afef05f79ac6 service nova] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:04:08.437056 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732add-8e25-4a4d-94aa-f54ec456315d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:04:08.437909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732add-8e25-4a4d-94aa-f54ec456315d service swift] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:04:08.438244 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732add-8e25-4a4d-94aa-f54ec456315d service swift] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:04:08.438520 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732add-8e25-4a4d-94aa-f54ec456315d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:04:08.449881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5732add-8e25-4a4d-94aa-f54ec456315d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:04:08.452296 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5732add-8e25-4a4d-94aa-f54ec456315d service swift] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:04:08.466654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1295/2531] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:04:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:04:10.620742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cfdeb-12c1-4851-b443-de0a969bdb09 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:04:10.621773 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cfdeb-12c1-4851-b443-de0a969bdb09 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:04:10.622878 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cfdeb-12c1-4851-b443-de0a969bdb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:04:10.669087 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f58cfdeb-12c1-4851-b443-de0a969bdb09 None None] MFA Rules not processed for user `02109279bdf1443d89eb8c219a967ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:04:10.670524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f58cfdeb-12c1-4851-b443-de0a969bdb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:04:10.684718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1237/2532] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:04:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:04:10.826913 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732add-8e25-4a4d-94aa-f54ec456315d service swift] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:04:10.863774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732add-8e25-4a4d-94aa-f54ec456315d service swift] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:04:10.872295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5ef8-82cb-4d04-898d-00b27e0114a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1875af7b72b247c9a2b5e1f2b2fb1eaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:04:10.873457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5ef8-82cb-4d04-898d-00b27e0114a3 service placement] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:04:10.873755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5ef8-82cb-4d04-898d-00b27e0114a3 service placement] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:04:10.877940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5ef8-82cb-4d04-898d-00b27e0114a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:04:10.877940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c3ca5ef8-82cb-4d04-898d-00b27e0114a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:04:10.895125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca5ef8-82cb-4d04-898d-00b27e0114a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:04:10.897976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca5ef8-82cb-4d04-898d-00b27e0114a3 service placement] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:04:10.924069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1296/2533] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:04:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:04:30.348729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3940b-0bb8-4245-ab3b-689a8b0f1d32 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:04:30.349263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3940b-0bb8-4245-ab3b-689a8b0f1d32 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:04:30.349379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3940b-0bb8-4245-ab3b-689a8b0f1d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:04:30.368789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-dfc3940b-0bb8-4245-ab3b-689a8b0f1d32 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:04:30.370199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dfc3940b-0bb8-4245-ab3b-689a8b0f1d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:04:30.377748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1238/2534] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 22:04:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:04:30.390391 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5ef8-82cb-4d04-898d-00b27e0114a3 service placement] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:04:30.402861 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5ef8-82cb-4d04-898d-00b27e0114a3 service placement] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:04:30.407911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe8778-9e98-4b6b-8bc0-0314d01ba68f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:04:30.408553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8778-9e98-4b6b-8bc0-0314d01ba68f service swift] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:04:30.408837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8778-9e98-4b6b-8bc0-0314d01ba68f service swift] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:04:30.409113 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8778-9e98-4b6b-8bc0-0314d01ba68f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:04:30.417518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe8778-9e98-4b6b-8bc0-0314d01ba68f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:04:30.419139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe8778-9e98-4b6b-8bc0-0314d01ba68f service swift] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:04:30.427546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1297/2535] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:04:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:04:47.246373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3940b-0bb8-4245-ab3b-689a8b0f1d32 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:04:47.261341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3940b-0bb8-4245-ab3b-689a8b0f1d32 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:04:47.269210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc03f6-39f7-4c1e-9ae6-cc77856e2f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:04:47.270323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc03f6-39f7-4c1e-9ae6-cc77856e2f84 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:04:47.270655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc03f6-39f7-4c1e-9ae6-cc77856e2f84 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:04:47.271004 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc03f6-39f7-4c1e-9ae6-cc77856e2f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:04:47.273069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-68fc03f6-39f7-4c1e-9ae6-cc77856e2f84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:04:47.343845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc03f6-39f7-4c1e-9ae6-cc77856e2f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:04:47.345725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc03f6-39f7-4c1e-9ae6-cc77856e2f84 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:04:47.356109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1239/2536] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:04:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:04:49.612233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf019bc9-ed9a-4269-aa46-bdbf2fcb3b7c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:04:49.612727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf019bc9-ed9a-4269-aa46-bdbf2fcb3b7c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:04:49.612831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf019bc9-ed9a-4269-aa46-bdbf2fcb3b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:04:49.631002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-cf019bc9-ed9a-4269-aa46-bdbf2fcb3b7c None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:04:49.632197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-cf019bc9-ed9a-4269-aa46-bdbf2fcb3b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:04:49.641021 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1298/2537] 10.222.0.26 () {58 vars in 967 bytes} [Mon Feb 28 22:04:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:04:49.653853 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc03f6-39f7-4c1e-9ae6-cc77856e2f84 service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:04:49.664734 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc03f6-39f7-4c1e-9ae6-cc77856e2f84 service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:04:49.670200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae05f3-322c-47fd-a531-527769ddd980 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:04:49.670833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae05f3-322c-47fd-a531-527769ddd980 service swift] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:04:49.671108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae05f3-322c-47fd-a531-527769ddd980 service swift] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:04:49.671375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae05f3-322c-47fd-a531-527769ddd980 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:04:49.679097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae05f3-322c-47fd-a531-527769ddd980 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:04:49.680656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae05f3-322c-47fd-a531-527769ddd980 service swift] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:04:49.688993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1240/2538] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:04:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:04:53.140422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401c33-7790-45aa-b282-8bb3072836f5 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:04:53.140935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401c33-7790-45aa-b282-8bb3072836f5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:04:53.141031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f401c33-7790-45aa-b282-8bb3072836f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:04:53.158422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-2f401c33-7790-45aa-b282-8bb3072836f5 None None] MFA Rules not processed for user `17cf385903a84e948fe861dc616746ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:04:53.159622 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2f401c33-7790-45aa-b282-8bb3072836f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:04:53.166597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1299/2539] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:04:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:05:59.346219 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae05f3-322c-47fd-a531-527769ddd980 service swift] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:05:59.355684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae05f3-322c-47fd-a531-527769ddd980 service swift] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:05:59.359422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2b91f-a1b2-4a2e-b136-bef075924488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:05:59.360101 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2b91f-a1b2-4a2e-b136-bef075924488 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:05:59.360379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2b91f-a1b2-4a2e-b136-bef075924488 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:05:59.360652 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2b91f-a1b2-4a2e-b136-bef075924488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:05:59.362473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0ef2b91f-a1b2-4a2e-b136-bef075924488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:05:59.422867 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2b91f-a1b2-4a2e-b136-bef075924488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:05:59.424327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2b91f-a1b2-4a2e-b136-bef075924488 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:05:59.433775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1241/2540] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 22:06:02.115079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f401c33-7790-45aa-b282-8bb3072836f5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:02.132790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f401c33-7790-45aa-b282-8bb3072836f5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:02.137978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6deab6-e78b-415d-b1af-96121e032f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:02.138814 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6deab6-e78b-415d-b1af-96121e032f8f service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:02.139242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6deab6-e78b-415d-b1af-96121e032f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:02.139525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6deab6-e78b-415d-b1af-96121e032f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:02.141546 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ac6deab6-e78b-415d-b1af-96121e032f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:02.212284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6deab6-e78b-415d-b1af-96121e032f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:02.213867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6deab6-e78b-415d-b1af-96121e032f8f service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:02.224249 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1300/2541] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:03.439187 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2b91f-a1b2-4a2e-b136-bef075924488 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:03.442724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0ef2b91f-a1b2-4a2e-b136-bef075924488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:03.455728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2b91f-a1b2-4a2e-b136-bef075924488 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:03.460759 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:03.462536 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:03.462536 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:03.462536 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] PATH_INFO: `/v3/users/b92aaa59fd1747da9626a8173258d194` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:03.477309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92aaa59fd1747da9626a8173258d194)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:03.479405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:03.781794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92aaa59fd1747da9626a8173258d194'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:03.782620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92aaa59fd1747da9626a8173258d194'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:03.884160 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92aaa59fd1747da9626a8173258d194'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:03.896998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92aaa59fd1747da9626a8173258d194'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:03.908195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92aaa59fd1747da9626a8173258d194'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:03.920294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1242/2542] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:06:03 2022] DELETE /identity/v3/users/b92aaa59fd1747da9626a8173258d194 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:03.995684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6deab6-e78b-415d-b1af-96121e032f8f service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:04.005044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6deab6-e78b-415d-b1af-96121e032f8f service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:04.115649 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbef4da-394d-48ba-82e1-40ee218558c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:04.116666 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbef4da-394d-48ba-82e1-40ee218558c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:04.116974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbef4da-394d-48ba-82e1-40ee218558c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:04.117247 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbef4da-394d-48ba-82e1-40ee218558c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:04.124489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4bbef4da-394d-48ba-82e1-40ee218558c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:04.230818 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbef4da-394d-48ba-82e1-40ee218558c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:04.232360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbef4da-394d-48ba-82e1-40ee218558c3 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:04.244167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1301/2543] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:04.282744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:04.284601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:04.374283 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f64f0-4d7a-4777-93c9-0434652a2c5c admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:04.380248 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:04.381208 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:04.382040 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:04.399743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] PATH_INFO: `/v3/projects/fdca1a6469bf40f180da2e8f5a4b61c6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:04.404294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdca1a6469bf40f180da2e8f5a4b61c6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:04.406404 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:04.510715 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdca1a6469bf40f180da2e8f5a4b61c6', 'request_id': 'req-31057130-b7cc-494f-b12f-64be96d7b51c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:04.517550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdca1a6469bf40f180da2e8f5a4b61c6', 'request_id': 'req-31057130-b7cc-494f-b12f-64be96d7b51c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:04.523232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdca1a6469bf40f180da2e8f5a4b61c6', 'request_id': 'req-31057130-b7cc-494f-b12f-64be96d7b51c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:04.624241 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] The token cache is being invalidate because project fdca1a6469bf40f180da2e8f5a4b61c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:06:04.624531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:04.625145 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-31057130-b7cc-494f-b12f-64be96d7b51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:04.626978 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1243/2544] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:06:04 2022] DELETE /identity/v3/projects/fdca1a6469bf40f180da2e8f5a4b61c6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:04.632762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba554f-46d7-45ca-8365-dc807bab0204 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:04.633053 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba554f-46d7-45ca-8365-dc807bab0204 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:04.633328 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba554f-46d7-45ca-8365-dc807bab0204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:04.652111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-80ba554f-46d7-45ca-8365-dc807bab0204 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:04.657391 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-80ba554f-46d7-45ca-8365-dc807bab0204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:04.716354 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1302/2545] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:04.724360 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6c25-d33f-4750-9a92-6d6f5fb5324b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:04.724651 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6c25-d33f-4750-9a92-6d6f5fb5324b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:04.724930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6c25-d33f-4750-9a92-6d6f5fb5324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:04.743240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-411c6c25-d33f-4750-9a92-6d6f5fb5324b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:04.744444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-411c6c25-d33f-4750-9a92-6d6f5fb5324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:04.754107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1244/2546] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:04.758257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba554f-46d7-45ca-8365-dc807bab0204 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:04.767660 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba554f-46d7-45ca-8365-dc807bab0204 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:04.772379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eb844-8a1b-4130-b0ce-aeb1dc68710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:04.773014 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eb844-8a1b-4130-b0ce-aeb1dc68710b admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:04.773291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eb844-8a1b-4130-b0ce-aeb1dc68710b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:04.773561 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eb844-8a1b-4130-b0ce-aeb1dc68710b admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:04.774312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eb844-8a1b-4130-b0ce-aeb1dc68710b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:06:04.774607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eb844-8a1b-4130-b0ce-aeb1dc68710b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:04.776188 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eb844-8a1b-4130-b0ce-aeb1dc68710b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:04.787333 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1303/2547] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:06:04.791511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c6c25-d33f-4750-9a92-6d6f5fb5324b None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:04.801305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c6c25-d33f-4750-9a92-6d6f5fb5324b None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:04.805941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09be36-7ffa-4670-84a2-dc6320e75b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:04.807330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09be36-7ffa-4670-84a2-dc6320e75b86 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:04.807330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09be36-7ffa-4670-84a2-dc6320e75b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:04.807330 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09be36-7ffa-4670-84a2-dc6320e75b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:04.807815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09be36-7ffa-4670-84a2-dc6320e75b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:04.809721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09be36-7ffa-4670-84a2-dc6320e75b86 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:04.905247 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1245/2548] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:06:04 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:06:04.909910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eb844-8a1b-4130-b0ce-aeb1dc68710b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:04.919672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eb844-8a1b-4130-b0ce-aeb1dc68710b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:04.973909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947e617-351e-4825-b9be-8c515f4160f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:04.974630 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e617-351e-4825-b9be-8c515f4160f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:04.974911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e617-351e-4825-b9be-8c515f4160f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:04.975184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e617-351e-4825-b9be-8c515f4160f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:04.975863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947e617-351e-4825-b9be-8c515f4160f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:04.977742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947e617-351e-4825-b9be-8c515f4160f2 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:05.121142 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1304/2549] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:06:04 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:06:05.125289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09be36-7ffa-4670-84a2-dc6320e75b86 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:05.135400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09be36-7ffa-4670-84a2-dc6320e75b86 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:05.140060 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2b60b-795d-4ea1-bcf6-597f7b2be06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:05.140712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2b60b-795d-4ea1-bcf6-597f7b2be06d admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:05.140989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2b60b-795d-4ea1-bcf6-597f7b2be06d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:05.141260 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2b60b-795d-4ea1-bcf6-597f7b2be06d admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:05.141977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2b60b-795d-4ea1-bcf6-597f7b2be06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:05.143819 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2b60b-795d-4ea1-bcf6-597f7b2be06d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:05.153432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1246/2550] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:06:05.157206 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947e617-351e-4825-b9be-8c515f4160f2 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:05.167585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947e617-351e-4825-b9be-8c515f4160f2 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:05.172357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c815e-0122-4614-8d1f-f4de0b5515ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:05.173018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c815e-0122-4614-8d1f-f4de0b5515ca admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:05.173300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c815e-0122-4614-8d1f-f4de0b5515ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:05.173573 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c815e-0122-4614-8d1f-f4de0b5515ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:05.174393 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c815e-0122-4614-8d1f-f4de0b5515ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:05.176544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c815e-0122-4614-8d1f-f4de0b5515ca admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:05.186501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1305/2551] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:06:05.190728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2b60b-795d-4ea1-bcf6-597f7b2be06d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:05.200619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2b60b-795d-4ea1-bcf6-597f7b2be06d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:05.205050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66f4cc-175f-480c-ab89-82477449ada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:05.206466 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66f4cc-175f-480c-ab89-82477449ada0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:05.206748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66f4cc-175f-480c-ab89-82477449ada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:05.207020 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66f4cc-175f-480c-ab89-82477449ada0 admin admin] PATH_INFO: `/v3/projects/5cb591938500456186a438a9d8bed48c/users/3d8cecc9dc9048799efbd50566c7d369/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:05.221842 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66f4cc-175f-480c-ab89-82477449ada0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb591938500456186a438a9d8bed48c, user_id=3d8cecc9dc9048799efbd50566c7d369, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:05.224558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66f4cc-175f-480c-ab89-82477449ada0 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:05.293145 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1247/2552] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:06:05 2022] PUT /identity/v3/projects/5cb591938500456186a438a9d8bed48c/users/3d8cecc9dc9048799efbd50566c7d369/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:05.303512 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4a3cc-f6eb-4de7-805a-ff74ef8f58d8 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:05.303806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4a3cc-f6eb-4de7-805a-ff74ef8f58d8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:05.304084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4a3cc-f6eb-4de7-805a-ff74ef8f58d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:05.329804 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-5fb4a3cc-f6eb-4de7-805a-ff74ef8f58d8 None None] MFA Rules not processed for user `3d8cecc9dc9048799efbd50566c7d369`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:05.331798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5fb4a3cc-f6eb-4de7-805a-ff74ef8f58d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:05.393724 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1306/2553] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:05.397868 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66f4cc-175f-480c-ab89-82477449ada0 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:05.443821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4a3cc-f6eb-4de7-805a-ff74ef8f58d8 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:05.445241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5fb4a3cc-f6eb-4de7-805a-ff74ef8f58d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:05.457381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66f4cc-175f-480c-ab89-82477449ada0 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:05.461932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec0abc-638e-41e1-927f-4cca7def9ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:05.462604 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec0abc-638e-41e1-927f-4cca7def9ade admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:05.462881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec0abc-638e-41e1-927f-4cca7def9ade admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:05.463151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec0abc-638e-41e1-927f-4cca7def9ade admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:05.463834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec0abc-638e-41e1-927f-4cca7def9ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:05.465732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec0abc-638e-41e1-927f-4cca7def9ade admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:05.501060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4a3cc-f6eb-4de7-805a-ff74ef8f58d8 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:05.504728 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa30cf-cf82-47ba-82e8-d9982e6d3e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:05.505359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa30cf-cf82-47ba-82e8-d9982e6d3e93 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:05.505636 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa30cf-cf82-47ba-82e8-d9982e6d3e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:05.505905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa30cf-cf82-47ba-82e8-d9982e6d3e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:05.507726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3ffa30cf-cf82-47ba-82e8-d9982e6d3e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:05.576677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa30cf-cf82-47ba-82e8-d9982e6d3e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:05.578139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa30cf-cf82-47ba-82e8-d9982e6d3e93 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:05.589438 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1307/2554] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 22:06:05.594721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1248/2555] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:06:05 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:06:05.604092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa30cf-cf82-47ba-82e8-d9982e6d3e93 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:05.605597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa30cf-cf82-47ba-82e8-d9982e6d3e93 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:05.660315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf494b-6c8e-4c8d-a8a7-987e9d185e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:05.660942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf494b-6c8e-4c8d-a8a7-987e9d185e62 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:05.661222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf494b-6c8e-4c8d-a8a7-987e9d185e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:05.661495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf494b-6c8e-4c8d-a8a7-987e9d185e62 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:05.662230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf494b-6c8e-4c8d-a8a7-987e9d185e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:05.664170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf494b-6c8e-4c8d-a8a7-987e9d185e62 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:05.787775 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1308/2556] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:06:05 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:06:05.789003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec0abc-638e-41e1-927f-4cca7def9ade admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:05.799295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec0abc-638e-41e1-927f-4cca7def9ade admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:05.804208 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda5e5-b36c-41b4-beb3-0d0ae12e8081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:05.804866 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda5e5-b36c-41b4-beb3-0d0ae12e8081 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:05.805129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda5e5-b36c-41b4-beb3-0d0ae12e8081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:05.805398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda5e5-b36c-41b4-beb3-0d0ae12e8081 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:05.806157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacda5e5-b36c-41b4-beb3-0d0ae12e8081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:05.807787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacda5e5-b36c-41b4-beb3-0d0ae12e8081 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:05.819681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1249/2557] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:06:05.823539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf494b-6c8e-4c8d-a8a7-987e9d185e62 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:05.834998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf494b-6c8e-4c8d-a8a7-987e9d185e62 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:05.840635 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47917aa-5660-4c1e-8c42-71c259ad34ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:05.841762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47917aa-5660-4c1e-8c42-71c259ad34ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:05.842121 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47917aa-5660-4c1e-8c42-71c259ad34ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:05.842401 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47917aa-5660-4c1e-8c42-71c259ad34ce admin admin] PATH_INFO: `/v3/projects/0da7d66ef01c4f2f9280a655cbe55f2c/users/54d3df807924424f929072d9d99dfbf1/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:05.858503 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47917aa-5660-4c1e-8c42-71c259ad34ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da7d66ef01c4f2f9280a655cbe55f2c, user_id=54d3df807924424f929072d9d99dfbf1, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:05.861357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47917aa-5660-4c1e-8c42-71c259ad34ce admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:05.967787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1309/2558] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:06:05 2022] PUT /identity/v3/projects/0da7d66ef01c4f2f9280a655cbe55f2c/users/54d3df807924424f929072d9d99dfbf1/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:05.972383 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda5e5-b36c-41b4-beb3-0d0ae12e8081 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:05.982401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda5e5-b36c-41b4-beb3-0d0ae12e8081 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:06.045168 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5e453-d3cb-4332-abe6-77a2f3a19d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:06.045168 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5e453-d3cb-4332-abe6-77a2f3a19d5d admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:06.045168 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5e453-d3cb-4332-abe6-77a2f3a19d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:06.045444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5e453-d3cb-4332-abe6-77a2f3a19d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:06.046138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5e453-d3cb-4332-abe6-77a2f3a19d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:06.047736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5e453-d3cb-4332-abe6-77a2f3a19d5d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:06.058233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1250/2559] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 22:06:06.062450 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47917aa-5660-4c1e-8c42-71c259ad34ce admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:06.073768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47917aa-5660-4c1e-8c42-71c259ad34ce admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:06.078683 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a8edf-046c-498f-a613-4bcc404be884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:06.079557 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8edf-046c-498f-a613-4bcc404be884 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:06.079909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8edf-046c-498f-a613-4bcc404be884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:06.080178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8edf-046c-498f-a613-4bcc404be884 admin admin] PATH_INFO: `/v3/projects/0da7d66ef01c4f2f9280a655cbe55f2c/users/54d3df807924424f929072d9d99dfbf1/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:06.082271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a8edf-046c-498f-a613-4bcc404be884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da7d66ef01c4f2f9280a655cbe55f2c, user_id=54d3df807924424f929072d9d99dfbf1, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:06.084898 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a8edf-046c-498f-a613-4bcc404be884 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:06.095403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1310/2560] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:06:06 2022] PUT /identity/v3/projects/0da7d66ef01c4f2f9280a655cbe55f2c/users/54d3df807924424f929072d9d99dfbf1/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:06.113532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fc94-ef96-4467-a611-b5077a8096b5 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:06.113822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fc94-ef96-4467-a611-b5077a8096b5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:06.114146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6fc94-ef96-4467-a611-b5077a8096b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:06.141833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-efc6fc94-ef96-4467-a611-b5077a8096b5 None None] MFA Rules not processed for user `54d3df807924424f929072d9d99dfbf1`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:06.143238 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-efc6fc94-ef96-4467-a611-b5077a8096b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:06.344375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1251/2561] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:06.356921 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a8edf-046c-498f-a613-4bcc404be884 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:06.358647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e13a8edf-046c-498f-a613-4bcc404be884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:06.417107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a8edf-046c-498f-a613-4bcc404be884 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:06.420892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9c1a9-eb89-4f7f-90ba-f25a2d15d6ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:06.421380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c1a9-eb89-4f7f-90ba-f25a2d15d6ee service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:06.421659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c1a9-eb89-4f7f-90ba-f25a2d15d6ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:06.421930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c1a9-eb89-4f7f-90ba-f25a2d15d6ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:06.432136 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9c1a9-eb89-4f7f-90ba-f25a2d15d6ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:06.433551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9c1a9-eb89-4f7f-90ba-f25a2d15d6ee service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:06.442964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1311/2562] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:06.633704 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6fc94-ef96-4467-a611-b5077a8096b5 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:06.643755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6fc94-ef96-4467-a611-b5077a8096b5 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:06.647912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cac07-f874-4c2e-a927-bd8b021bb00d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:06.649184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cac07-f874-4c2e-a927-bd8b021bb00d service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:06.649184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cac07-f874-4c2e-a927-bd8b021bb00d service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:06.649381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cac07-f874-4c2e-a927-bd8b021bb00d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:06.711145 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cac07-f874-4c2e-a927-bd8b021bb00d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:06.712643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cac07-f874-4c2e-a927-bd8b021bb00d service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:06.723576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1252/2563] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:08.182560 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9c1a9-eb89-4f7f-90ba-f25a2d15d6ee service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:08.236896 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9c1a9-eb89-4f7f-90ba-f25a2d15d6ee service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:08.240714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46752714-99d9-40af-8f6a-a0b3fb522843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:08.241360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46752714-99d9-40af-8f6a-a0b3fb522843 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:08.241645 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46752714-99d9-40af-8f6a-a0b3fb522843 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:08.241923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46752714-99d9-40af-8f6a-a0b3fb522843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:08.243740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-46752714-99d9-40af-8f6a-a0b3fb522843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:08.310794 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46752714-99d9-40af-8f6a-a0b3fb522843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:08.312254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46752714-99d9-40af-8f6a-a0b3fb522843 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:08.322104 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1312/2564] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:15.938902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cac07-f874-4c2e-a927-bd8b021bb00d service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:15.941113 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-250cac07-f874-4c2e-a927-bd8b021bb00d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:15.955529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cac07-f874-4c2e-a927-bd8b021bb00d service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:15.960267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:15.961115 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:15.961395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:15.961663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] PATH_INFO: `/v3/users/7c2b6f493a8146969afc9820f2f1a8ae` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:15.963022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2b6f493a8146969afc9820f2f1a8ae)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:15.964919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:16.192663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2b6f493a8146969afc9820f2f1a8ae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:16.193346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2b6f493a8146969afc9820f2f1a8ae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:16.286759 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2b6f493a8146969afc9820f2f1a8ae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:16.297501 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2b6f493a8146969afc9820f2f1a8ae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:16.307022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2b6f493a8146969afc9820f2f1a8ae'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:16.313117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1253/2565] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:06:15 2022] DELETE /identity/v3/users/7c2b6f493a8146969afc9820f2f1a8ae => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:16.591497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46752714-99d9-40af-8f6a-a0b3fb522843 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:16.603727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46752714-99d9-40af-8f6a-a0b3fb522843 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:16.662716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:16.663572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:16.663880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:16.664156 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] PATH_INFO: `/v3/projects/41fad17e39fc4970a4688f9d08a37877` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:16.665331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41fad17e39fc4970a4688f9d08a37877)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:16.667272 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:16.788781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41fad17e39fc4970a4688f9d08a37877', 'request_id': 'req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:16.794956 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41fad17e39fc4970a4688f9d08a37877', 'request_id': 'req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:16.875530 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41fad17e39fc4970a4688f9d08a37877', 'request_id': 'req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:16.887609 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] The token cache is being invalidate because project 41fad17e39fc4970a4688f9d08a37877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:06:16.893193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:16.893193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:16.893193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1313/2566] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:06:16 2022] DELETE /identity/v3/projects/41fad17e39fc4970a4688f9d08a37877 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:16.896620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:16.898050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:16.915699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43275995-ee46-49be-9084-d458e1c39309 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:16.971025 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:16.971941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:16.972218 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:16.972488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] PATH_INFO: `/v3/users/435d18359e7942c9aeb49ef39635a18e` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:16.973656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435d18359e7942c9aeb49ef39635a18e)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:16.975614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:17.266328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435d18359e7942c9aeb49ef39635a18e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:17.266952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435d18359e7942c9aeb49ef39635a18e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:17.359824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435d18359e7942c9aeb49ef39635a18e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:17.367998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435d18359e7942c9aeb49ef39635a18e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:17.380494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435d18359e7942c9aeb49ef39635a18e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:17.386371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1254/2567] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:06:16 2022] DELETE /identity/v3/users/435d18359e7942c9aeb49ef39635a18e => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:17.648072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:17.649531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:17.663603 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6618-bc73-4145-9d47-f74da7c8dcc8 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:17.720954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:17.722909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:17.723212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:17.723489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] PATH_INFO: `/v3/projects/5c9afa14d6d0454398dd47812852e2a9` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:17.724676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9afa14d6d0454398dd47812852e2a9)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:17.726684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:17.841544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9afa14d6d0454398dd47812852e2a9', 'request_id': 'req-634ef518-89cd-444f-b5df-00eb5b887cd8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:17.848601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9afa14d6d0454398dd47812852e2a9', 'request_id': 'req-634ef518-89cd-444f-b5df-00eb5b887cd8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:17.955265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9afa14d6d0454398dd47812852e2a9', 'request_id': 'req-634ef518-89cd-444f-b5df-00eb5b887cd8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:17.967050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] The token cache is being invalidate because project 5c9afa14d6d0454398dd47812852e2a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:06:17.967336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:17.967967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-634ef518-89cd-444f-b5df-00eb5b887cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:17.969492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1314/2568] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:06:17 2022] DELETE /identity/v3/projects/5c9afa14d6d0454398dd47812852e2a9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:19.679395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:19.680843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:19.694144 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670b6a9-cf05-4cd0-8cda-dc07feaa4d60 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:19.750512 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:19.751299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:19.751574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:19.751843 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] PATH_INFO: `/v3/users/3d8cecc9dc9048799efbd50566c7d369` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:19.753033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8cecc9dc9048799efbd50566c7d369)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:19.755011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:19.934998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8cecc9dc9048799efbd50566c7d369'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:19.935655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8cecc9dc9048799efbd50566c7d369'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:20.006876 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8cecc9dc9048799efbd50566c7d369'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:20.014325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8cecc9dc9048799efbd50566c7d369'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:20.026293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8cecc9dc9048799efbd50566c7d369'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:20.032010 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1255/2569] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:06:19 2022] DELETE /identity/v3/users/3d8cecc9dc9048799efbd50566c7d369 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:20.037210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44cd5-ccf9-44ba-ac17-cb18c01f0a44 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:20.037745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44cd5-ccf9-44ba-ac17-cb18c01f0a44 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:20.037745 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44cd5-ccf9-44ba-ac17-cb18c01f0a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:20.055324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-08e44cd5-ccf9-44ba-ac17-cb18c01f0a44 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:20.056539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-08e44cd5-ccf9-44ba-ac17-cb18c01f0a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:20.112396 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1315/2570] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:20.122291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:20.123655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:20.178286 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b83ed7-9399-463b-b492-2ac489e0fd3a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:20.181967 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8087-5430-4e92-92dd-f364f0731474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:20.182638 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8087-5430-4e92-92dd-f364f0731474 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:20.182920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8087-5430-4e92-92dd-f364f0731474 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:20.183194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8087-5430-4e92-92dd-f364f0731474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:20.193112 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a8087-5430-4e92-92dd-f364f0731474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:20.194618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a8087-5430-4e92-92dd-f364f0731474 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:20.204194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1256/2571] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:20.688090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e44cd5-ccf9-44ba-ac17-cb18c01f0a44 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:20.689531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-08e44cd5-ccf9-44ba-ac17-cb18c01f0a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:20.702016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e44cd5-ccf9-44ba-ac17-cb18c01f0a44 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:20.706870 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:20.708157 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:20.708356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:20.709153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] PATH_INFO: `/v3/projects/5cb591938500456186a438a9d8bed48c` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:20.710666 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb591938500456186a438a9d8bed48c)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:20.712498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:20.852847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb591938500456186a438a9d8bed48c', 'request_id': 'req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:20.859257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb591938500456186a438a9d8bed48c', 'request_id': 'req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:20.937575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb591938500456186a438a9d8bed48c', 'request_id': 'req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:20.948357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] The token cache is being invalidate because project 5cb591938500456186a438a9d8bed48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:06:20.948639 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:20.949253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:20.951124 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1316/2572] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:06:20 2022] DELETE /identity/v3/projects/5cb591938500456186a438a9d8bed48c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:20.955210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8087-5430-4e92-92dd-f364f0731474 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:20.965123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8087-5430-4e92-92dd-f364f0731474 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:21.017681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:21.018568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:21.018842 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:21.019106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] PATH_INFO: `/v3/users/54d3df807924424f929072d9d99dfbf1` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:21.020966 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d3df807924424f929072d9d99dfbf1)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:21.022898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:21.201924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d3df807924424f929072d9d99dfbf1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:21.202577 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d3df807924424f929072d9d99dfbf1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:21.287272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d3df807924424f929072d9d99dfbf1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:21.294122 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d3df807924424f929072d9d99dfbf1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:21.305429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-9b069f20-d1f5-499d-bcb4-da9d4fe68f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d3df807924424f929072d9d99dfbf1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:21.311144 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1257/2573] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:06:20 2022] DELETE /identity/v3/users/54d3df807924424f929072d9d99dfbf1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:21.808739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:21.810245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:21.825318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b9c0-651a-48d8-936a-7e1e1f78ebbb admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:21.881696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:21.882588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:21.882877 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:21.883147 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] PATH_INFO: `/v3/projects/0da7d66ef01c4f2f9280a655cbe55f2c` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:21.884312 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da7d66ef01c4f2f9280a655cbe55f2c)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:21.886220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:21.982696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da7d66ef01c4f2f9280a655cbe55f2c', 'request_id': 'req-88a41281-7dc2-4dc9-85cf-164491626f46'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:21.989309 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da7d66ef01c4f2f9280a655cbe55f2c', 'request_id': 'req-88a41281-7dc2-4dc9-85cf-164491626f46'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:22.073918 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da7d66ef01c4f2f9280a655cbe55f2c', 'request_id': 'req-88a41281-7dc2-4dc9-85cf-164491626f46'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:22.084463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] The token cache is being invalidate because project 0da7d66ef01c4f2f9280a655cbe55f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:06:22.084749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:22.085382 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-88a41281-7dc2-4dc9-85cf-164491626f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:22.086959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1317/2574] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:06:21 2022] DELETE /identity/v3/projects/0da7d66ef01c4f2f9280a655cbe55f2c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:22.091930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771bdbf-f6f7-434b-9545-4fe903cf1958 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:22.092413 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771bdbf-f6f7-434b-9545-4fe903cf1958 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:22.092507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771bdbf-f6f7-434b-9545-4fe903cf1958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:22.111003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9771bdbf-f6f7-434b-9545-4fe903cf1958 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:22.112224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9771bdbf-f6f7-434b-9545-4fe903cf1958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:22.169414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1258/2575] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:22.177899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1042a-5ebb-4e9e-86cf-94701a09cb6c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:22.178213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1042a-5ebb-4e9e-86cf-94701a09cb6c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:22.178492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1042a-5ebb-4e9e-86cf-94701a09cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:22.196314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-09a1042a-5ebb-4e9e-86cf-94701a09cb6c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:22.197488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-09a1042a-5ebb-4e9e-86cf-94701a09cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:22.205375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1318/2576] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:22.209547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771bdbf-f6f7-434b-9545-4fe903cf1958 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:22.218856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771bdbf-f6f7-434b-9545-4fe903cf1958 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:22.224118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3eabc-43d4-481f-80c9-345c06786deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:22.224755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3eabc-43d4-481f-80c9-345c06786deb admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:22.225033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3eabc-43d4-481f-80c9-345c06786deb admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:22.225310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3eabc-43d4-481f-80c9-345c06786deb admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:22.226052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3eabc-43d4-481f-80c9-345c06786deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:06:22.226361 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3eabc-43d4-481f-80c9-345c06786deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:22.227941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3eabc-43d4-481f-80c9-345c06786deb admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:22.239544 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1259/2577] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:06:22.243812 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1042a-5ebb-4e9e-86cf-94701a09cb6c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:22.252893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1042a-5ebb-4e9e-86cf-94701a09cb6c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:22.257670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fdf2a-e288-4d34-8ca4-d676c236d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:22.258327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fdf2a-e288-4d34-8ca4-d676c236d89f admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:22.258608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fdf2a-e288-4d34-8ca4-d676c236d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:22.258879 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fdf2a-e288-4d34-8ca4-d676c236d89f admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:22.259564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fdf2a-e288-4d34-8ca4-d676c236d89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:22.261471 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fdf2a-e288-4d34-8ca4-d676c236d89f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:22.368259 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1319/2578] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:06:22 2022] POST /identity/v3/projects => generated 357 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:06:22.372380 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3eabc-43d4-481f-80c9-345c06786deb admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:22.382284 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3eabc-43d4-481f-80c9-345c06786deb admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:22.436159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deadb0b-e14c-4221-909a-00e5501f73f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:22.436820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deadb0b-e14c-4221-909a-00e5501f73f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:22.437100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deadb0b-e14c-4221-909a-00e5501f73f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:22.437374 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deadb0b-e14c-4221-909a-00e5501f73f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:22.438075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deadb0b-e14c-4221-909a-00e5501f73f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:22.439973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deadb0b-e14c-4221-909a-00e5501f73f0 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:22.560659 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1260/2579] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:06:22 2022] POST /identity/v3/users => generated 279 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:06:22.564836 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fdf2a-e288-4d34-8ca4-d676c236d89f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:22.575318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fdf2a-e288-4d34-8ca4-d676c236d89f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:22.579911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f049b-86a9-442d-baaa-aad51f88de61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:22.580554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f049b-86a9-442d-baaa-aad51f88de61 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:22.580834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f049b-86a9-442d-baaa-aad51f88de61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:22.581109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f049b-86a9-442d-baaa-aad51f88de61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:22.581826 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f049b-86a9-442d-baaa-aad51f88de61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:22.584231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f049b-86a9-442d-baaa-aad51f88de61 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:22.594300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1320/2580] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:06:22.601192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deadb0b-e14c-4221-909a-00e5501f73f0 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:22.611098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deadb0b-e14c-4221-909a-00e5501f73f0 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:22.615922 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63949263-a910-487e-8832-0d375aa1e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:22.616597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63949263-a910-487e-8832-0d375aa1e5bf admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:22.616877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63949263-a910-487e-8832-0d375aa1e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:22.617151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63949263-a910-487e-8832-0d375aa1e5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:22.617871 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63949263-a910-487e-8832-0d375aa1e5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:22.619540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63949263-a910-487e-8832-0d375aa1e5bf admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:22.631233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1261/2581] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:06:22.634323 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f049b-86a9-442d-baaa-aad51f88de61 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:22.644023 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f049b-86a9-442d-baaa-aad51f88de61 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:22.649885 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20724953-044c-476d-8adf-51ad130da3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:22.650808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20724953-044c-476d-8adf-51ad130da3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:22.651088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20724953-044c-476d-8adf-51ad130da3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:22.651361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20724953-044c-476d-8adf-51ad130da3d4 admin admin] PATH_INFO: `/v3/projects/a32b43a355444dfdac684c3921d6fafa/users/f078779c2a4746e2b2ba5670ff22f3ff/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:22.673923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20724953-044c-476d-8adf-51ad130da3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32b43a355444dfdac684c3921d6fafa, user_id=f078779c2a4746e2b2ba5670ff22f3ff, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:22.676872 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20724953-044c-476d-8adf-51ad130da3d4 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:22.743155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1321/2582] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:06:22 2022] PUT /identity/v3/projects/a32b43a355444dfdac684c3921d6fafa/users/f078779c2a4746e2b2ba5670ff22f3ff/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:22.754647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf93d5c-80b0-4a2a-8b50-8571622f0c86 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:22.754928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf93d5c-80b0-4a2a-8b50-8571622f0c86 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:22.755200 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf93d5c-80b0-4a2a-8b50-8571622f0c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:22.781448 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-edf93d5c-80b0-4a2a-8b50-8571622f0c86 None None] MFA Rules not processed for user `f078779c2a4746e2b2ba5670ff22f3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:22.782718 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-edf93d5c-80b0-4a2a-8b50-8571622f0c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:22.844732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1262/2583] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:22 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:06:22.849264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20724953-044c-476d-8adf-51ad130da3d4 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:22.907324 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20724953-044c-476d-8adf-51ad130da3d4 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:22.911968 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7dde3-1f53-423f-a49a-f4387c0fcd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:22.912614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7dde3-1f53-423f-a49a-f4387c0fcd2b admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:22.912893 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7dde3-1f53-423f-a49a-f4387c0fcd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:22.913164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7dde3-1f53-423f-a49a-f4387c0fcd2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:22.913860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7dde3-1f53-423f-a49a-f4387c0fcd2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:22.915749 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7dde3-1f53-423f-a49a-f4387c0fcd2b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:22.996077 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1322/2584] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:06:22 2022] POST /identity/v3/projects => generated 357 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:06:23.000059 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf93d5c-80b0-4a2a-8b50-8571622f0c86 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:23.010919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf93d5c-80b0-4a2a-8b50-8571622f0c86 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:23.065944 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ac419-ce00-4ffc-959f-51265d7deb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:23.067630 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac419-ce00-4ffc-959f-51265d7deb04 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:23.067912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac419-ce00-4ffc-959f-51265d7deb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:23.068192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac419-ce00-4ffc-959f-51265d7deb04 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:23.068881 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ac419-ce00-4ffc-959f-51265d7deb04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:23.070829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ac419-ce00-4ffc-959f-51265d7deb04 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:23.154903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1263/2585] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:06:22 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:06:23.158875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7dde3-1f53-423f-a49a-f4387c0fcd2b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:23.169433 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7dde3-1f53-423f-a49a-f4387c0fcd2b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:23.173935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4803ac-f131-47b4-816a-14e41b0fbeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:23.174606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4803ac-f131-47b4-816a-14e41b0fbeeb admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:23.174884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4803ac-f131-47b4-816a-14e41b0fbeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:23.175158 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4803ac-f131-47b4-816a-14e41b0fbeeb admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:23.175975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4803ac-f131-47b4-816a-14e41b0fbeeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:23.177654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4803ac-f131-47b4-816a-14e41b0fbeeb admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:23.188810 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1323/2586] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:06:23.192951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ac419-ce00-4ffc-959f-51265d7deb04 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:23.202989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ac419-ce00-4ffc-959f-51265d7deb04 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:23.208309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ece5b6-e25f-46e3-85ba-f3244e7034e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:23.209176 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece5b6-e25f-46e3-85ba-f3244e7034e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:23.209455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece5b6-e25f-46e3-85ba-f3244e7034e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:23.209730 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ece5b6-e25f-46e3-85ba-f3244e7034e6 admin admin] PATH_INFO: `/v3/projects/0da403d2e9434e4791868bdfaf3baf2b/users/a1c097852b7044868840d49f13012426/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:23.224368 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ece5b6-e25f-46e3-85ba-f3244e7034e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da403d2e9434e4791868bdfaf3baf2b, user_id=a1c097852b7044868840d49f13012426, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:23.227103 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ece5b6-e25f-46e3-85ba-f3244e7034e6 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:23.292304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1264/2587] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:06:23 2022] PUT /identity/v3/projects/0da403d2e9434e4791868bdfaf3baf2b/users/a1c097852b7044868840d49f13012426/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:23.296315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4803ac-f131-47b4-816a-14e41b0fbeeb admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:23.306115 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4803ac-f131-47b4-816a-14e41b0fbeeb admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:23.360741 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0b38b-b8ce-4505-a27f-f041c5f96067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:23.361402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0b38b-b8ce-4505-a27f-f041c5f96067 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:23.361677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0b38b-b8ce-4505-a27f-f041c5f96067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:23.361944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0b38b-b8ce-4505-a27f-f041c5f96067 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:23.362678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0b38b-b8ce-4505-a27f-f041c5f96067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:23.364265 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0b38b-b8ce-4505-a27f-f041c5f96067 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:23.373432 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1324/2588] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:06:23.377585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ece5b6-e25f-46e3-85ba-f3244e7034e6 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:23.387826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ece5b6-e25f-46e3-85ba-f3244e7034e6 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:23.392321 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221ef7-70d9-4f8c-8f4f-cf79f86fab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:23.393180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221ef7-70d9-4f8c-8f4f-cf79f86fab04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:23.393455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221ef7-70d9-4f8c-8f4f-cf79f86fab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:23.393726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221ef7-70d9-4f8c-8f4f-cf79f86fab04 admin admin] PATH_INFO: `/v3/projects/0da403d2e9434e4791868bdfaf3baf2b/users/a1c097852b7044868840d49f13012426/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:23.396286 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df221ef7-70d9-4f8c-8f4f-cf79f86fab04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da403d2e9434e4791868bdfaf3baf2b, user_id=a1c097852b7044868840d49f13012426, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:23.398925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df221ef7-70d9-4f8c-8f4f-cf79f86fab04 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:23.408701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1265/2589] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:06:23 2022] PUT /identity/v3/projects/0da403d2e9434e4791868bdfaf3baf2b/users/a1c097852b7044868840d49f13012426/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:06:23.419257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b106f-b2c9-45fb-921f-71ce14804dea None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:23.419484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b106f-b2c9-45fb-921f-71ce14804dea None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:23.419758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b106f-b2c9-45fb-921f-71ce14804dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:23.446313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e12b106f-b2c9-45fb-921f-71ce14804dea None None] MFA Rules not processed for user `a1c097852b7044868840d49f13012426`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:23.448261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e12b106f-b2c9-45fb-921f-71ce14804dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:23.514052 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1325/2590] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:23 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:23.526319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221ef7-70d9-4f8c-8f4f-cf79f86fab04 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:23.528003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-df221ef7-70d9-4f8c-8f4f-cf79f86fab04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:23.583137 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221ef7-70d9-4f8c-8f4f-cf79f86fab04 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:23.586792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963bd31-86c0-49b0-91db-a9d49bd0f50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:23.587426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963bd31-86c0-49b0-91db-a9d49bd0f50e service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:23.587703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963bd31-86c0-49b0-91db-a9d49bd0f50e service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:23.587970 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963bd31-86c0-49b0-91db-a9d49bd0f50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:23.596554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963bd31-86c0-49b0-91db-a9d49bd0f50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:23.598037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963bd31-86c0-49b0-91db-a9d49bd0f50e service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:23.607018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1266/2591] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:23 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:23.795082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b106f-b2c9-45fb-921f-71ce14804dea None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:23.804671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b106f-b2c9-45fb-921f-71ce14804dea None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:23.808210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b21b0b-254e-45bd-a226-b5868769e5bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:23.808831 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21b0b-254e-45bd-a226-b5868769e5bf service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:23.809108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21b0b-254e-45bd-a226-b5868769e5bf service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:23.809379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b21b0b-254e-45bd-a226-b5868769e5bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:23.865254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b21b0b-254e-45bd-a226-b5868769e5bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:23.866719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b21b0b-254e-45bd-a226-b5868769e5bf service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:23.875337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1326/2592] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:23 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:33.434346 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963bd31-86c0-49b0-91db-a9d49bd0f50e service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:33.442959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963bd31-86c0-49b0-91db-a9d49bd0f50e service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:33.447147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69f8b4-02fd-4062-a2f6-801e4be84959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:33.447769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69f8b4-02fd-4062-a2f6-801e4be84959 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:33.448047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69f8b4-02fd-4062-a2f6-801e4be84959 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:33.448375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69f8b4-02fd-4062-a2f6-801e4be84959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:33.450447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-bd69f8b4-02fd-4062-a2f6-801e4be84959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:33.507065 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69f8b4-02fd-4062-a2f6-801e4be84959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:33.509064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69f8b4-02fd-4062-a2f6-801e4be84959 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:33.518045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1267/2593] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:45.376700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42787e5-5e69-478e-b7c8-b98d6eb3a4aa None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:45.377239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42787e5-5e69-478e-b7c8-b98d6eb3a4aa None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:45.377239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42787e5-5e69-478e-b7c8-b98d6eb3a4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:45.393675 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e42787e5-5e69-478e-b7c8-b98d6eb3a4aa None None] MFA Rules not processed for user `02109279bdf1443d89eb8c219a967ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:45.398771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e42787e5-5e69-478e-b7c8-b98d6eb3a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:45.401963 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1327/2594] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:46.459128 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69f8b4-02fd-4062-a2f6-801e4be84959 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:46.463362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-bd69f8b4-02fd-4062-a2f6-801e4be84959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:46.531273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69f8b4-02fd-4062-a2f6-801e4be84959 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:46.536305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c85701-74ac-480e-95f3-f01a3cd3eca1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1875af7b72b247c9a2b5e1f2b2fb1eaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:46.536942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c85701-74ac-480e-95f3-f01a3cd3eca1 service placement] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:46.537223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c85701-74ac-480e-95f3-f01a3cd3eca1 service placement] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:46.537497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c85701-74ac-480e-95f3-f01a3cd3eca1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:46.539288 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b6c85701-74ac-480e-95f3-f01a3cd3eca1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:46.551400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c85701-74ac-480e-95f3-f01a3cd3eca1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:46.552971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c85701-74ac-480e-95f3-f01a3cd3eca1 service placement] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:46.563076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1268/2595] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:48.005956 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42787e5-5e69-478e-b7c8-b98d6eb3a4aa None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:48.007360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e42787e5-5e69-478e-b7c8-b98d6eb3a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:48.061118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42787e5-5e69-478e-b7c8-b98d6eb3a4aa None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:48.064760 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b70e1-0ff1-42be-acf6-fcd69dcfbe60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:48.065394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b70e1-0ff1-42be-acf6-fcd69dcfbe60 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:48.065678 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b70e1-0ff1-42be-acf6-fcd69dcfbe60 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:48.065950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b70e1-0ff1-42be-acf6-fcd69dcfbe60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:48.067726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2b6b70e1-0ff1-42be-acf6-fcd69dcfbe60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:48.127234 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b70e1-0ff1-42be-acf6-fcd69dcfbe60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:48.128696 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b70e1-0ff1-42be-acf6-fcd69dcfbe60 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:48.138789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1328/2596] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:49.740339 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c85701-74ac-480e-95f3-f01a3cd3eca1 service placement] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:49.753202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c85701-74ac-480e-95f3-f01a3cd3eca1 service placement] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:49.757870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6caa1f-8ec5-42e8-b125-c05ec83931dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:49.760675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6caa1f-8ec5-42e8-b125-c05ec83931dd service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:49.760675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6caa1f-8ec5-42e8-b125-c05ec83931dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:49.760953 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6caa1f-8ec5-42e8-b125-c05ec83931dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:49.763100 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9b6caa1f-8ec5-42e8-b125-c05ec83931dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:49.774407 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6caa1f-8ec5-42e8-b125-c05ec83931dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:49.776387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6caa1f-8ec5-42e8-b125-c05ec83931dd service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:49.787103 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1269/2597] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:50.449048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b70e1-0ff1-42be-acf6-fcd69dcfbe60 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:50.459082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b70e1-0ff1-42be-acf6-fcd69dcfbe60 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:50.464034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:50.465101 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:50.465402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:50.465656 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] PATH_INFO: `/v3/users/f078779c2a4746e2b2ba5670ff22f3ff` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:50.466959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f078779c2a4746e2b2ba5670ff22f3ff)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:50.469011 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:50.715511 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f078779c2a4746e2b2ba5670ff22f3ff'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:50.722279 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f078779c2a4746e2b2ba5670ff22f3ff'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:50.834064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f078779c2a4746e2b2ba5670ff22f3ff'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:50.847456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f078779c2a4746e2b2ba5670ff22f3ff'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:50.848154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f078779c2a4746e2b2ba5670ff22f3ff'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:50.855246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1329/2598] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:06:50 2022] DELETE /identity/v3/users/f078779c2a4746e2b2ba5670ff22f3ff => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:50.859748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845b382-a1dc-4456-a75c-395c8e58ddc7 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:50.860213 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845b382-a1dc-4456-a75c-395c8e58ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:50.860345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845b382-a1dc-4456-a75c-395c8e58ddc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:50.883681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-2845b382-a1dc-4456-a75c-395c8e58ddc7 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:50.883681 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2845b382-a1dc-4456-a75c-395c8e58ddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:50.962802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1270/2599] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:50.983680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:50.985522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:51.054999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065665e-940a-49bf-b80a-36a5877eae97 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:51.059554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60109a25-d3ea-4de6-96d4-f31a4280e2c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:51.060332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109a25-d3ea-4de6-96d4-f31a4280e2c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:51.060717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109a25-d3ea-4de6-96d4-f31a4280e2c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:51.061093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109a25-d3ea-4de6-96d4-f31a4280e2c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:51.080092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60109a25-d3ea-4de6-96d4-f31a4280e2c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:51.092055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60109a25-d3ea-4de6-96d4-f31a4280e2c7 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:51.108509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1330/2600] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:51.979154 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845b382-a1dc-4456-a75c-395c8e58ddc7 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:51.980657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-2845b382-a1dc-4456-a75c-395c8e58ddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:51.993907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845b382-a1dc-4456-a75c-395c8e58ddc7 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:51.999085 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:51.999855 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:52.000271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:52.000547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] PATH_INFO: `/v3/projects/a32b43a355444dfdac684c3921d6fafa` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:52.001753 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32b43a355444dfdac684c3921d6fafa)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:52.003700 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:52.194605 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32b43a355444dfdac684c3921d6fafa', 'request_id': 'req-790433ec-b80e-49cc-92c9-2a16ec596f68'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:52.218798 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32b43a355444dfdac684c3921d6fafa', 'request_id': 'req-790433ec-b80e-49cc-92c9-2a16ec596f68'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:52.235290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32b43a355444dfdac684c3921d6fafa', 'request_id': 'req-790433ec-b80e-49cc-92c9-2a16ec596f68'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:52.314745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] The token cache is being invalidate because project a32b43a355444dfdac684c3921d6fafa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:06:52.315174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:52.315724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:52.317594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1271/2601] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:06:51 2022] DELETE /identity/v3/projects/a32b43a355444dfdac684c3921d6fafa => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:06:52.323997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60109a25-d3ea-4de6-96d4-f31a4280e2c7 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:52.334574 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60109a25-d3ea-4de6-96d4-f31a4280e2c7 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:52.389326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:52.390231 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:52.390504 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:52.390779 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] PATH_INFO: `/v3/users/a1c097852b7044868840d49f13012426` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:52.391991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c097852b7044868840d49f13012426)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:52.393889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:52.613099 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c097852b7044868840d49f13012426'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:52.621399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c097852b7044868840d49f13012426'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:52.697530 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c097852b7044868840d49f13012426'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:52.710453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c097852b7044868840d49f13012426'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:52.711140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5cbe1748-7313-4d7a-ac2d-b32575e2ddbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c097852b7044868840d49f13012426'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:52.718348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1331/2602] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:06:52 2022] DELETE /identity/v3/users/a1c097852b7044868840d49f13012426 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:53.221639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:53.221639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:53.233780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790433ec-b80e-49cc-92c9-2a16ec596f68 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:53.318823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:53.320115 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:53.320115 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:53.320397 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] PATH_INFO: `/v3/projects/0da403d2e9434e4791868bdfaf3baf2b` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:53.322494 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da403d2e9434e4791868bdfaf3baf2b)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:53.324700 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:53.480186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da403d2e9434e4791868bdfaf3baf2b', 'request_id': 'req-b93b2156-0ca3-4153-be67-238d744578f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:53.486364 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da403d2e9434e4791868bdfaf3baf2b', 'request_id': 'req-b93b2156-0ca3-4153-be67-238d744578f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:53.491925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da403d2e9434e4791868bdfaf3baf2b', 'request_id': 'req-b93b2156-0ca3-4153-be67-238d744578f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:53.559317 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] The token cache is being invalidate because project 0da403d2e9434e4791868bdfaf3baf2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:06:53.559618 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:53.560291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-b93b2156-0ca3-4153-be67-238d744578f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:53.562313 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1272/2603] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:06:53 2022] DELETE /identity/v3/projects/0da403d2e9434e4791868bdfaf3baf2b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:53.567148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835c4f-94b1-4936-8ac2-fdd51723063a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:53.571346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835c4f-94b1-4936-8ac2-fdd51723063a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:53.571346 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835c4f-94b1-4936-8ac2-fdd51723063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:53.586705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-c4835c4f-94b1-4936-8ac2-fdd51723063a None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:53.587967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c4835c4f-94b1-4936-8ac2-fdd51723063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:53.650504 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1332/2604] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:53.659057 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa46ad-ad23-4a65-afd5-1743a660a4f7 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:53.659336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa46ad-ad23-4a65-afd5-1743a660a4f7 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:53.659620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa46ad-ad23-4a65-afd5-1743a660a4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:53.677840 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-81aa46ad-ad23-4a65-afd5-1743a660a4f7 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:53.679061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-81aa46ad-ad23-4a65-afd5-1743a660a4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:53.687559 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1273/2605] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:53.691840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835c4f-94b1-4936-8ac2-fdd51723063a None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:53.702314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835c4f-94b1-4936-8ac2-fdd51723063a None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:53.706998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33663223-d86c-4d2c-8dab-7957464f0a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:53.707653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33663223-d86c-4d2c-8dab-7957464f0a33 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:53.707942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33663223-d86c-4d2c-8dab-7957464f0a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:53.708228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33663223-d86c-4d2c-8dab-7957464f0a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:53.708941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33663223-d86c-4d2c-8dab-7957464f0a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:06:53.709243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33663223-d86c-4d2c-8dab-7957464f0a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:53.710940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33663223-d86c-4d2c-8dab-7957464f0a33 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:53.722307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1333/2606] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:06:53.726451 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa46ad-ad23-4a65-afd5-1743a660a4f7 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:53.736553 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa46ad-ad23-4a65-afd5-1743a660a4f7 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:53.743545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592fe30-4b8a-477f-aa75-bb2e451eb94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:53.744851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592fe30-4b8a-477f-aa75-bb2e451eb94b admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:53.745167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592fe30-4b8a-477f-aa75-bb2e451eb94b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:53.745421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592fe30-4b8a-477f-aa75-bb2e451eb94b admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:53.746167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592fe30-4b8a-477f-aa75-bb2e451eb94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:53.746395 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33663223-d86c-4d2c-8dab-7957464f0a33 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:53.748083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592fe30-4b8a-477f-aa75-bb2e451eb94b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:53.748270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-33663223-d86c-4d2c-8dab-7957464f0a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:53.763386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33663223-d86c-4d2c-8dab-7957464f0a33 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:53.768069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:53.768928 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:53.769204 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:53.769509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] PATH_INFO: `/v3/users/17cf385903a84e948fe861dc616746ae` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:53.770735 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=17cf385903a84e948fe861dc616746ae)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:53.772628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:53.892807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1274/2607] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:06:53 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:06:53.897051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592fe30-4b8a-477f-aa75-bb2e451eb94b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:53.960126 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592fe30-4b8a-477f-aa75-bb2e451eb94b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:53.967553 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82091da4-7782-4c67-af17-8b1b1f6df7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:53.968105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82091da4-7782-4c67-af17-8b1b1f6df7ae admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:53.968388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82091da4-7782-4c67-af17-8b1b1f6df7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:53.968652 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82091da4-7782-4c67-af17-8b1b1f6df7ae admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:53.969339 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82091da4-7782-4c67-af17-8b1b1f6df7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:53.971287 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82091da4-7782-4c67-af17-8b1b1f6df7ae admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:53.981961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17cf385903a84e948fe861dc616746ae'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:53.989111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17cf385903a84e948fe861dc616746ae'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:54.057433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1275/2608] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:06:53 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:06:54.061948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82091da4-7782-4c67-af17-8b1b1f6df7ae admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.072670 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82091da4-7782-4c67-af17-8b1b1f6df7ae admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.079937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890157e-747d-4a1e-876f-e56929f3bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.080674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890157e-747d-4a1e-876f-e56929f3bfda admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.081064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890157e-747d-4a1e-876f-e56929f3bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.081342 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890157e-747d-4a1e-876f-e56929f3bfda admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.082094 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890157e-747d-4a1e-876f-e56929f3bfda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.083680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890157e-747d-4a1e-876f-e56929f3bfda admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.085530 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17cf385903a84e948fe861dc616746ae'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:54.099773 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17cf385903a84e948fe861dc616746ae'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:54.100515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17cf385903a84e948fe861dc616746ae'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:54.104289 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1276/2609] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 22:06:54.107909 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1334/2610] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:06:53 2022] DELETE /identity/v3/users/17cf385903a84e948fe861dc616746ae => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:06:54.108045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890157e-747d-4a1e-876f-e56929f3bfda admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.112017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-0890157e-747d-4a1e-876f-e56929f3bfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:54.124763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890157e-747d-4a1e-876f-e56929f3bfda admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.194911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae8688-563d-4453-bb1a-033909ef7ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.195699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8688-563d-4453-bb1a-033909ef7ade admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.196819 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8688-563d-4453-bb1a-033909ef7ade admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.197598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8688-563d-4453-bb1a-033909ef7ade admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.198400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae8688-563d-4453-bb1a-033909ef7ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.200322 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae8688-563d-4453-bb1a-033909ef7ade admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.210676 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1277/2611] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 22:06:54.215044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.224946 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fd7eb-b6b4-46f3-a30f-ab133b917dac admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.230963 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c92d2-4132-48c8-a82f-76a590e3278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.231948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c92d2-4132-48c8-a82f-76a590e3278b admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.232295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c92d2-4132-48c8-a82f-76a590e3278b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.232662 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c92d2-4132-48c8-a82f-76a590e3278b admin admin] PATH_INFO: `/v3/projects/485e7fc76c13470681d7d69dc1a12f4e/users/87998fdd2b24463dbe9483d45a9dca3f/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.248179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c92d2-4132-48c8-a82f-76a590e3278b admin admin] RBAC: Authorizing `identity:create_grant(project_id=485e7fc76c13470681d7d69dc1a12f4e, user_id=87998fdd2b24463dbe9483d45a9dca3f, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.250943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c92d2-4132-48c8-a82f-76a590e3278b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.326233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1335/2612] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:06:54 2022] PUT /identity/v3/projects/485e7fc76c13470681d7d69dc1a12f4e/users/87998fdd2b24463dbe9483d45a9dca3f/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:06:54.336883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a954339-d5df-4ac5-87a7-1cf8578b8823 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.337385 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a954339-d5df-4ac5-87a7-1cf8578b8823 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.337560 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a954339-d5df-4ac5-87a7-1cf8578b8823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.364180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c92d2-4132-48c8-a82f-76a590e3278b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.366027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-c22c92d2-4132-48c8-a82f-76a590e3278b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:54.378988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9a954339-d5df-4ac5-87a7-1cf8578b8823 None None] MFA Rules not processed for user `87998fdd2b24463dbe9483d45a9dca3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:54.380258 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9a954339-d5df-4ac5-87a7-1cf8578b8823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:54.432263 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c92d2-4132-48c8-a82f-76a590e3278b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.437044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.437890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.438196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.438469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] PATH_INFO: `/v3/projects/4e415d1871af4d26a84530ed592e1239` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.439647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e415d1871af4d26a84530ed592e1239)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.441531 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.452916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1278/2613] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:54.457285 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a954339-d5df-4ac5-87a7-1cf8578b8823 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.467268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a954339-d5df-4ac5-87a7-1cf8578b8823 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.471857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433b18e-8e86-4c92-839e-bb59831d4c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.472478 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433b18e-8e86-4c92-839e-bb59831d4c5d admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.472757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433b18e-8e86-4c92-839e-bb59831d4c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.473032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433b18e-8e86-4c92-839e-bb59831d4c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.473717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433b18e-8e86-4c92-839e-bb59831d4c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.475633 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433b18e-8e86-4c92-839e-bb59831d4c5d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.558511 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e415d1871af4d26a84530ed592e1239', 'request_id': 'req-371ca48f-70bb-410a-8ae3-8a9bdfa78016'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:54.564523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e415d1871af4d26a84530ed592e1239', 'request_id': 'req-371ca48f-70bb-410a-8ae3-8a9bdfa78016'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:54.578049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1279/2614] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:06:54 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:06:54.581887 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433b18e-8e86-4c92-839e-bb59831d4c5d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.622657 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e415d1871af4d26a84530ed592e1239', 'request_id': 'req-371ca48f-70bb-410a-8ae3-8a9bdfa78016'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:54.633653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] The token cache is being invalidate because project 4e415d1871af4d26a84530ed592e1239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:06:54.636523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:54.636523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-371ca48f-70bb-410a-8ae3-8a9bdfa78016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:54.640175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1336/2615] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:06:54 2022] DELETE /identity/v3/projects/4e415d1871af4d26a84530ed592e1239 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:54.640830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433b18e-8e86-4c92-839e-bb59831d4c5d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.641502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d88f38-421a-4a63-8a25-d7ef3ab508fd None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.641787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d88f38-421a-4a63-8a25-d7ef3ab508fd None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.642093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d88f38-421a-4a63-8a25-d7ef3ab508fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.645657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b827fe-4cff-46fb-9a1e-6ac16e2f5866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.646355 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b827fe-4cff-46fb-9a1e-6ac16e2f5866 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.646626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b827fe-4cff-46fb-9a1e-6ac16e2f5866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.646898 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b827fe-4cff-46fb-9a1e-6ac16e2f5866 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.647892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b827fe-4cff-46fb-9a1e-6ac16e2f5866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.650323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b827fe-4cff-46fb-9a1e-6ac16e2f5866 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.660470 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-17d88f38-421a-4a63-8a25-d7ef3ab508fd None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:54.661653 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-17d88f38-421a-4a63-8a25-d7ef3ab508fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:54.670720 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1337/2616] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:54.678418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711daf0-34b7-449d-969b-ad69e32cd4b5 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.678729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711daf0-34b7-449d-969b-ad69e32cd4b5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.679008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711daf0-34b7-449d-969b-ad69e32cd4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.698258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-8711daf0-34b7-449d-969b-ad69e32cd4b5 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:54.705448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-8711daf0-34b7-449d-969b-ad69e32cd4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:54.711340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1338/2617] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:06:54.715593 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711daf0-34b7-449d-969b-ad69e32cd4b5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.724258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711daf0-34b7-449d-969b-ad69e32cd4b5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.729003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a29b7-ec65-4e1a-96f4-7d9d868492c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.729639 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a29b7-ec65-4e1a-96f4-7d9d868492c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.729936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a29b7-ec65-4e1a-96f4-7d9d868492c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.730224 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a29b7-ec65-4e1a-96f4-7d9d868492c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.730944 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a29b7-ec65-4e1a-96f4-7d9d868492c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:06:54.731411 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1280/2618] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:06:54 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:06:54.731553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a29b7-ec65-4e1a-96f4-7d9d868492c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.732882 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a29b7-ec65-4e1a-96f4-7d9d868492c8 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.734941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b827fe-4cff-46fb-9a1e-6ac16e2f5866 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.736936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-70b827fe-4cff-46fb-9a1e-6ac16e2f5866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:54.745234 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1339/2619] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 22:06:54.749326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a29b7-ec65-4e1a-96f4-7d9d868492c8 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.749836 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b827fe-4cff-46fb-9a1e-6ac16e2f5866 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.754601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eade1-2657-4459-a4ba-326da8cacb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.755297 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eade1-2657-4459-a4ba-326da8cacb37 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.755587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eade1-2657-4459-a4ba-326da8cacb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.755887 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eade1-2657-4459-a4ba-326da8cacb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.756619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97eade1-2657-4459-a4ba-326da8cacb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.758255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97eade1-2657-4459-a4ba-326da8cacb37 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.759330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a29b7-ec65-4e1a-96f4-7d9d868492c8 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.764250 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897964f3-bc88-4351-b43b-315e3e1c9998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.764913 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897964f3-bc88-4351-b43b-315e3e1c9998 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.765242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897964f3-bc88-4351-b43b-315e3e1c9998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.765523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897964f3-bc88-4351-b43b-315e3e1c9998 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.766239 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897964f3-bc88-4351-b43b-315e3e1c9998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.768107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897964f3-bc88-4351-b43b-315e3e1c9998 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.769925 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1281/2620] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 22:06:54.773926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eade1-2657-4459-a4ba-326da8cacb37 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.784204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eade1-2657-4459-a4ba-326da8cacb37 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.788902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b5faf-4284-4a47-b8d6-06a405824eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.790302 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b5faf-4284-4a47-b8d6-06a405824eff admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.790594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b5faf-4284-4a47-b8d6-06a405824eff admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.790872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b5faf-4284-4a47-b8d6-06a405824eff admin admin] PATH_INFO: `/v3/projects/881c5a954f72491b8db4c7b7fa3cec0e/users/2cfee59ca7bb4b428479414abb29beec/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.805802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b5faf-4284-4a47-b8d6-06a405824eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=881c5a954f72491b8db4c7b7fa3cec0e, user_id=2cfee59ca7bb4b428479414abb29beec, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.809044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b5faf-4284-4a47-b8d6-06a405824eff admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.855417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1340/2621] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:06:54 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:06:54.856567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897964f3-bc88-4351-b43b-315e3e1c9998 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.874635 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1282/2622] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:06:54 2022] PUT /identity/v3/projects/881c5a954f72491b8db4c7b7fa3cec0e/users/2cfee59ca7bb4b428479414abb29beec/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:06:54.878553 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b5faf-4284-4a47-b8d6-06a405824eff admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.917513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897964f3-bc88-4351-b43b-315e3e1c9998 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.938149 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b5faf-4284-4a47-b8d6-06a405824eff admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.942807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25575c97-cb1b-4243-b1b5-3011edbce98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.943464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575c97-cb1b-4243-b1b5-3011edbce98f admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.943743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575c97-cb1b-4243-b1b5-3011edbce98f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.944016 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575c97-cb1b-4243-b1b5-3011edbce98f admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.944742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25575c97-cb1b-4243-b1b5-3011edbce98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.946693 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25575c97-cb1b-4243-b1b5-3011edbce98f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.956788 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1283/2623] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:06:54.960856 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25575c97-cb1b-4243-b1b5-3011edbce98f admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:54.970476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25575c97-cb1b-4243-b1b5-3011edbce98f admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:54.970884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18a4b2-4bc4-419e-b740-398f6af31ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.971551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18a4b2-4bc4-419e-b740-398f6af31ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.971835 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18a4b2-4bc4-419e-b740-398f6af31ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.972106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18a4b2-4bc4-419e-b740-398f6af31ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.972781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18a4b2-4bc4-419e-b740-398f6af31ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.974721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18a4b2-4bc4-419e-b740-398f6af31ba1 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.976301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222206f0-40d5-4fff-9ede-0af82e443738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:54.977642 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222206f0-40d5-4fff-9ede-0af82e443738 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:54.977921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222206f0-40d5-4fff-9ede-0af82e443738 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:54.978310 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222206f0-40d5-4fff-9ede-0af82e443738 admin admin] PATH_INFO: `/v3/projects/881c5a954f72491b8db4c7b7fa3cec0e/users/2cfee59ca7bb4b428479414abb29beec/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:54.980374 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222206f0-40d5-4fff-9ede-0af82e443738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881c5a954f72491b8db4c7b7fa3cec0e, user_id=2cfee59ca7bb4b428479414abb29beec, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:54.983037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222206f0-40d5-4fff-9ede-0af82e443738 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:54.994045 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1284/2624] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:06:54 2022] PUT /identity/v3/projects/881c5a954f72491b8db4c7b7fa3cec0e/users/2cfee59ca7bb4b428479414abb29beec/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:06:55.005280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297e5ff-6cbd-4d15-a469-210bc055dbe2 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:55.005562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297e5ff-6cbd-4d15-a469-210bc055dbe2 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:55.005833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297e5ff-6cbd-4d15-a469-210bc055dbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:55.031001 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-3297e5ff-6cbd-4d15-a469-210bc055dbe2 None None] MFA Rules not processed for user `2cfee59ca7bb4b428479414abb29beec`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:55.032231 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3297e5ff-6cbd-4d15-a469-210bc055dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:55.080233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1341/2625] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:06:54 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:06:55.083871 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18a4b2-4bc4-419e-b740-398f6af31ba1 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:55.094505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18a4b2-4bc4-419e-b740-398f6af31ba1 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:55.104486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1285/2626] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:06:55.116211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297e5ff-6cbd-4d15-a469-210bc055dbe2 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:55.117727 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3297e5ff-6cbd-4d15-a469-210bc055dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:55.154511 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647218-dd79-4cf8-bb2f-1dc8c6dc1e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:55.155299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647218-dd79-4cf8-bb2f-1dc8c6dc1e9b admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:55.155580 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647218-dd79-4cf8-bb2f-1dc8c6dc1e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:55.156008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647218-dd79-4cf8-bb2f-1dc8c6dc1e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:55.156798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11647218-dd79-4cf8-bb2f-1dc8c6dc1e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:55.158348 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11647218-dd79-4cf8-bb2f-1dc8c6dc1e9b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:55.169775 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1342/2627] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 22:06:55.173276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647218-dd79-4cf8-bb2f-1dc8c6dc1e9b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:55.181281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297e5ff-6cbd-4d15-a469-210bc055dbe2 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:55.184517 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647218-dd79-4cf8-bb2f-1dc8c6dc1e9b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:55.185344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd625d1-9e09-4733-abac-93f2466970b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:55.186013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd625d1-9e09-4733-abac-93f2466970b4 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:55.186307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd625d1-9e09-4733-abac-93f2466970b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:55.186586 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd625d1-9e09-4733-abac-93f2466970b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:55.189698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cc673-bbf0-4b35-9a8f-5a288ee566b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:55.190607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cc673-bbf0-4b35-9a8f-5a288ee566b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:55.191397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cc673-bbf0-4b35-9a8f-5a288ee566b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:55.191397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cc673-bbf0-4b35-9a8f-5a288ee566b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:55.192066 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cc673-bbf0-4b35-9a8f-5a288ee566b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:55.193693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cc673-bbf0-4b35-9a8f-5a288ee566b4 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:55.196357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd625d1-9e09-4733-abac-93f2466970b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:55.198167 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd625d1-9e09-4733-abac-93f2466970b4 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:55.204631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1343/2628] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 22:06:55.208389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cc673-bbf0-4b35-9a8f-5a288ee566b4 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:55.210676 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1286/2629] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 22:06:55.218085 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cc673-bbf0-4b35-9a8f-5a288ee566b4 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:55.222607 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ce244-4be4-487a-9291-5598e7c989db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:55.223474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ce244-4be4-487a-9291-5598e7c989db admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:55.223750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ce244-4be4-487a-9291-5598e7c989db admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:55.224019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ce244-4be4-487a-9291-5598e7c989db admin admin] PATH_INFO: `/v3/projects/38c5deb84f8b4bfe855fe0e3b7ef6489/users/7a4590988e5b499b8c2c4f9ecd3d05ff/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:55.238894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ce244-4be4-487a-9291-5598e7c989db admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c5deb84f8b4bfe855fe0e3b7ef6489, user_id=7a4590988e5b499b8c2c4f9ecd3d05ff, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:55.241493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ce244-4be4-487a-9291-5598e7c989db admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:55.314336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1344/2630] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:06:55 2022] PUT /identity/v3/projects/38c5deb84f8b4bfe855fe0e3b7ef6489/users/7a4590988e5b499b8c2c4f9ecd3d05ff/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:06:55.319647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d6b37-b1a8-436e-a654-ac15dccb4fec None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:55.319932 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d6b37-b1a8-436e-a654-ac15dccb4fec None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:55.320199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d6b37-b1a8-436e-a654-ac15dccb4fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:55.337624 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-e65d6b37-b1a8-436e-a654-ac15dccb4fec None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:55.338857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e65d6b37-b1a8-436e-a654-ac15dccb4fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:55.394996 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ce244-4be4-487a-9291-5598e7c989db admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:55.396742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1287/2631] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:06:55.406453 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d6b37-b1a8-436e-a654-ac15dccb4fec None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:55.407840 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e65d6b37-b1a8-436e-a654-ac15dccb4fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:55.451366 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ce244-4be4-487a-9291-5598e7c989db admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:55.455006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fb6a6-feca-4bec-9a0d-87365c5f89d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:55.455648 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fb6a6-feca-4bec-9a0d-87365c5f89d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:55.455921 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fb6a6-feca-4bec-9a0d-87365c5f89d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:55.456189 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fb6a6-feca-4bec-9a0d-87365c5f89d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:55.457964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-514fb6a6-feca-4bec-9a0d-87365c5f89d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:55.466527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d6b37-b1a8-436e-a654-ac15dccb4fec None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:55.470156 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d11f7-3ba1-4f6c-8961-7a6e07a61fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:55.470793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d11f7-3ba1-4f6c-8961-7a6e07a61fed service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:55.471090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d11f7-3ba1-4f6c-8961-7a6e07a61fed service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:55.471362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d11f7-3ba1-4f6c-8961-7a6e07a61fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:55.480458 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d11f7-3ba1-4f6c-8961-7a6e07a61fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:55.481875 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d11f7-3ba1-4f6c-8961-7a6e07a61fed service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:55.491724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1288/2632] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 22:06:55.650752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fb6a6-feca-4bec-9a0d-87365c5f89d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:55.652096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514fb6a6-feca-4bec-9a0d-87365c5f89d6 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:55.660936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1345/2633] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:56.571573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064cc68-5b6e-450c-a8b9-a0130a2cc3e6 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:56.572091 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064cc68-5b6e-450c-a8b9-a0130a2cc3e6 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:56.572215 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064cc68-5b6e-450c-a8b9-a0130a2cc3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:56.598510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-e064cc68-5b6e-450c-a8b9-a0130a2cc3e6 None None] MFA Rules not processed for user `7a4590988e5b499b8c2c4f9ecd3d05ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:56.599716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e064cc68-5b6e-450c-a8b9-a0130a2cc3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:56.661145 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1289/2634] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:06:56.673308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065f02-ac78-4fa8-bd2b-fd0c325610d8 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:56.673787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065f02-ac78-4fa8-bd2b-fd0c325610d8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:56.673881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065f02-ac78-4fa8-bd2b-fd0c325610d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:56.691628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-fb065f02-ac78-4fa8-bd2b-fd0c325610d8 None None] MFA Rules not processed for user `7a4590988e5b499b8c2c4f9ecd3d05ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:56.692837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fb065f02-ac78-4fa8-bd2b-fd0c325610d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:56.700583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1346/2635] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:06:56.712904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064cc68-5b6e-450c-a8b9-a0130a2cc3e6 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:56.714321 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e064cc68-5b6e-450c-a8b9-a0130a2cc3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:56.785257 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064cc68-5b6e-450c-a8b9-a0130a2cc3e6 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:56.791381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d08ffa-9bc5-49fc-bba9-b5c1894bb176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:56.792014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08ffa-9bc5-49fc-bba9-b5c1894bb176 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:56.792290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08ffa-9bc5-49fc-bba9-b5c1894bb176 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:56.792562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08ffa-9bc5-49fc-bba9-b5c1894bb176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:56.800003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d08ffa-9bc5-49fc-bba9-b5c1894bb176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:56.801576 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d08ffa-9bc5-49fc-bba9-b5c1894bb176 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:56.810227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1290/2636] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:06:59.258113 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065f02-ac78-4fa8-bd2b-fd0c325610d8 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:59.269731 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065f02-ac78-4fa8-bd2b-fd0c325610d8 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:59.274370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:59.275217 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:59.275492 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:59.275755 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] PATH_INFO: `/v3/users/87998fdd2b24463dbe9483d45a9dca3f` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:59.276994 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87998fdd2b24463dbe9483d45a9dca3f)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:59.278991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:59.452798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87998fdd2b24463dbe9483d45a9dca3f'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:59.459522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87998fdd2b24463dbe9483d45a9dca3f'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:59.513358 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87998fdd2b24463dbe9483d45a9dca3f'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:59.525092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87998fdd2b24463dbe9483d45a9dca3f'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:59.525797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87998fdd2b24463dbe9483d45a9dca3f'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:06:59.531539 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1347/2637] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:06:59 2022] DELETE /identity/v3/users/87998fdd2b24463dbe9483d45a9dca3f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:06:59.536225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c520-d0ed-4473-9f46-16266a207b71 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:59.536686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c520-d0ed-4473-9f46-16266a207b71 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:59.536780 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c520-d0ed-4473-9f46-16266a207b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:59.553961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-be87c520-d0ed-4473-9f46-16266a207b71 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:06:59.555829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-be87c520-d0ed-4473-9f46-16266a207b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:59.613071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1291/2638] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:06:59.623327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:06:59.624798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:06:59.686712 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0955ee5-51cf-4a87-a7d5-65adde3ccd7d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:06:59.690390 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8da90-017f-4e38-8ebe-c8ea419c37f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:06:59.690942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8da90-017f-4e38-8ebe-c8ea419c37f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:06:59.695334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8da90-017f-4e38-8ebe-c8ea419c37f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:06:59.695334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8da90-017f-4e38-8ebe-c8ea419c37f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:06:59.700930 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8da90-017f-4e38-8ebe-c8ea419c37f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:06:59.702388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8da90-017f-4e38-8ebe-c8ea419c37f9 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:06:59.711736 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1348/2639] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:00.143146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c520-d0ed-4473-9f46-16266a207b71 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:00.144674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-be87c520-d0ed-4473-9f46-16266a207b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:00.167114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c520-d0ed-4473-9f46-16266a207b71 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:00.171869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:00.172735 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:00.173049 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:00.173320 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] PATH_INFO: `/v3/projects/485e7fc76c13470681d7d69dc1a12f4e` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:00.174564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=485e7fc76c13470681d7d69dc1a12f4e)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:00.176538 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:00.279945 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485e7fc76c13470681d7d69dc1a12f4e', 'request_id': 'req-eecee262-368f-4768-92d9-a21e6e4d1b1c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:00.285915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485e7fc76c13470681d7d69dc1a12f4e', 'request_id': 'req-eecee262-368f-4768-92d9-a21e6e4d1b1c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:00.291656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485e7fc76c13470681d7d69dc1a12f4e', 'request_id': 'req-eecee262-368f-4768-92d9-a21e6e4d1b1c'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:00.337352 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] The token cache is being invalidate because project 485e7fc76c13470681d7d69dc1a12f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:07:00.337616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:00.338108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:00.342752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1292/2640] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:07:00 2022] DELETE /identity/v3/projects/485e7fc76c13470681d7d69dc1a12f4e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:07:00.344783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8da90-017f-4e38-8ebe-c8ea419c37f9 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:00.356768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8da90-017f-4e38-8ebe-c8ea419c37f9 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:00.414988 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:00.415858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:00.416135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:00.416406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] PATH_INFO: `/v3/users/2cfee59ca7bb4b428479414abb29beec` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:00.417590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cfee59ca7bb4b428479414abb29beec)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:00.419740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:00.572992 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cfee59ca7bb4b428479414abb29beec'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:00.579795 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cfee59ca7bb4b428479414abb29beec'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:00.639166 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cfee59ca7bb4b428479414abb29beec'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:00.654729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cfee59ca7bb4b428479414abb29beec'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:00.655654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-3231d658-bb51-4b39-90a5-c77b8a685193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cfee59ca7bb4b428479414abb29beec'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:00.662125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1349/2641] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:07:00 2022] DELETE /identity/v3/users/2cfee59ca7bb4b428479414abb29beec => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:01.269545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:01.271092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:01.284153 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee262-368f-4768-92d9-a21e6e4d1b1c admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:01.352781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:01.353643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:01.353919 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:01.360381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] PATH_INFO: `/v3/projects/881c5a954f72491b8db4c7b7fa3cec0e` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:01.360381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] RBAC: Authorizing `identity:delete_project(project_id=881c5a954f72491b8db4c7b7fa3cec0e)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:01.360381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:01.462872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881c5a954f72491b8db4c7b7fa3cec0e', 'request_id': 'req-4c464228-8652-4081-8641-b6d4f50c970b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:01.470501 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881c5a954f72491b8db4c7b7fa3cec0e', 'request_id': 'req-4c464228-8652-4081-8641-b6d4f50c970b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:01.476450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881c5a954f72491b8db4c7b7fa3cec0e', 'request_id': 'req-4c464228-8652-4081-8641-b6d4f50c970b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:01.552516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] The token cache is being invalidate because project 881c5a954f72491b8db4c7b7fa3cec0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:07:01.552803 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:01.553409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-4c464228-8652-4081-8641-b6d4f50c970b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:01.555004 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1293/2642] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:07:01 2022] DELETE /identity/v3/projects/881c5a954f72491b8db4c7b7fa3cec0e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:01.560319 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c35b-abf8-4288-a0e7-99ca25851c6c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:01.560785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c35b-abf8-4288-a0e7-99ca25851c6c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:01.560878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c35b-abf8-4288-a0e7-99ca25851c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:01.579318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-5259c35b-abf8-4288-a0e7-99ca25851c6c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:01.580517 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5259c35b-abf8-4288-a0e7-99ca25851c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:01.639701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1350/2643] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:07:01.648648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b585-71d6-43b4-8f57-74a2563dad17 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:01.649781 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b585-71d6-43b4-8f57-74a2563dad17 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:01.650276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b585-71d6-43b4-8f57-74a2563dad17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:01.668002 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-6fb4b585-71d6-43b4-8f57-74a2563dad17 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:01.669181 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6fb4b585-71d6-43b4-8f57-74a2563dad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:01.676951 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1294/2644] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:07:01.681699 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c35b-abf8-4288-a0e7-99ca25851c6c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:01.691148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c35b-abf8-4288-a0e7-99ca25851c6c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:01.696331 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e811e54-7530-46b9-8444-d5cacb355039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:01.697164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e811e54-7530-46b9-8444-d5cacb355039 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:01.697445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e811e54-7530-46b9-8444-d5cacb355039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:01.697716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e811e54-7530-46b9-8444-d5cacb355039 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:01.698736 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e811e54-7530-46b9-8444-d5cacb355039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:07:01.699037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e811e54-7530-46b9-8444-d5cacb355039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:01.700615 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e811e54-7530-46b9-8444-d5cacb355039 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:01.712993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1351/2645] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 22:07:01.717329 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b585-71d6-43b4-8f57-74a2563dad17 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:01.729648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b585-71d6-43b4-8f57-74a2563dad17 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:01.731664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408eab-a212-4a84-a2be-5434e4633260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:01.732325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408eab-a212-4a84-a2be-5434e4633260 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:01.732606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408eab-a212-4a84-a2be-5434e4633260 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:01.732883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408eab-a212-4a84-a2be-5434e4633260 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:01.733609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57408eab-a212-4a84-a2be-5434e4633260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:01.735540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57408eab-a212-4a84-a2be-5434e4633260 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:01.876334 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1295/2646] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:07:01 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:07:01.880357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e811e54-7530-46b9-8444-d5cacb355039 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:01.894424 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e811e54-7530-46b9-8444-d5cacb355039 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:01.964935 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3db5d-fabf-4054-9dba-fcd37482e9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:01.965633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3db5d-fabf-4054-9dba-fcd37482e9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:01.965904 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3db5d-fabf-4054-9dba-fcd37482e9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:01.966246 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3db5d-fabf-4054-9dba-fcd37482e9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:01.969633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3db5d-fabf-4054-9dba-fcd37482e9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:01.974469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3db5d-fabf-4054-9dba-fcd37482e9d5 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:02.068334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1352/2647] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:07:01 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:07:02.073026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408eab-a212-4a84-a2be-5434e4633260 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:02.085414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408eab-a212-4a84-a2be-5434e4633260 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:02.090997 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5b873-1982-47b7-b8a8-145ca902c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:02.091658 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b873-1982-47b7-b8a8-145ca902c7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:02.091934 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b873-1982-47b7-b8a8-145ca902c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:02.092232 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b873-1982-47b7-b8a8-145ca902c7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:02.092949 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5b873-1982-47b7-b8a8-145ca902c7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:02.094595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5b873-1982-47b7-b8a8-145ca902c7d3 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:02.105130 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1296/2648] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:07:02.118368 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3db5d-fabf-4054-9dba-fcd37482e9d5 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:02.128912 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3db5d-fabf-4054-9dba-fcd37482e9d5 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:02.135664 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef98b1a-09a5-41a5-9f22-5c28233d7b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:02.136356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef98b1a-09a5-41a5-9f22-5c28233d7b7a admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:02.136901 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef98b1a-09a5-41a5-9f22-5c28233d7b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:02.137373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef98b1a-09a5-41a5-9f22-5c28233d7b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:02.138140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef98b1a-09a5-41a5-9f22-5c28233d7b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:02.139715 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef98b1a-09a5-41a5-9f22-5c28233d7b7a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:02.153848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1353/2649] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:07:02.158013 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5b873-1982-47b7-b8a8-145ca902c7d3 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:02.168866 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5b873-1982-47b7-b8a8-145ca902c7d3 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:02.176104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe09f-9395-4987-9b2a-280cd5f0fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:02.176104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe09f-9395-4987-9b2a-280cd5f0fc50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:02.176104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe09f-9395-4987-9b2a-280cd5f0fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:02.176104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe09f-9395-4987-9b2a-280cd5f0fc50 admin admin] PATH_INFO: `/v3/projects/a8c4be36b2e54e4ebd8f87c7ab4a5e17/users/c4ef61518f6d475ea21d9b2ff64b0406/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:02.195108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfe09f-9395-4987-9b2a-280cd5f0fc50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c4be36b2e54e4ebd8f87c7ab4a5e17, user_id=c4ef61518f6d475ea21d9b2ff64b0406, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:02.198969 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfe09f-9395-4987-9b2a-280cd5f0fc50 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:02.313959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1297/2650] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:07:02 2022] PUT /identity/v3/projects/a8c4be36b2e54e4ebd8f87c7ab4a5e17/users/c4ef61518f6d475ea21d9b2ff64b0406/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:02.325179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2fe5-3fbf-4b66-afa7-baae48a28c0d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:02.325466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2fe5-3fbf-4b66-afa7-baae48a28c0d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:02.325740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2fe5-3fbf-4b66-afa7-baae48a28c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:02.351228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-544f2fe5-3fbf-4b66-afa7-baae48a28c0d None None] MFA Rules not processed for user `c4ef61518f6d475ea21d9b2ff64b0406`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:02.352444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-544f2fe5-3fbf-4b66-afa7-baae48a28c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:02.422101 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1354/2651] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:07:02.426731 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe09f-9395-4987-9b2a-280cd5f0fc50 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:02.489338 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe09f-9395-4987-9b2a-280cd5f0fc50 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:02.494832 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e1882-753d-435f-bad3-e2abc3742956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:02.495510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e1882-753d-435f-bad3-e2abc3742956 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:02.495792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e1882-753d-435f-bad3-e2abc3742956 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:02.496074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e1882-753d-435f-bad3-e2abc3742956 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:02.496824 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e1882-753d-435f-bad3-e2abc3742956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:02.498779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e1882-753d-435f-bad3-e2abc3742956 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:02.595587 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1298/2652] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:07:02 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:07:02.600633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f2fe5-3fbf-4b66-afa7-baae48a28c0d None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:02.614549 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f2fe5-3fbf-4b66-afa7-baae48a28c0d None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:02.680020 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e158a9b-d30b-4acc-baee-2b0a959a4e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:02.682091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e158a9b-d30b-4acc-baee-2b0a959a4e1f admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:02.682911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e158a9b-d30b-4acc-baee-2b0a959a4e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:02.682911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e158a9b-d30b-4acc-baee-2b0a959a4e1f admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:02.687616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e158a9b-d30b-4acc-baee-2b0a959a4e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:02.687616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e158a9b-d30b-4acc-baee-2b0a959a4e1f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:02.805329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1355/2653] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:07:02 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:07:02.809490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e1882-753d-435f-bad3-e2abc3742956 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:02.820354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e1882-753d-435f-bad3-e2abc3742956 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:02.825907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6841d55-a1bf-436a-9e38-c3ca9455e858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:02.826640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841d55-a1bf-436a-9e38-c3ca9455e858 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:02.827116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841d55-a1bf-436a-9e38-c3ca9455e858 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:02.827400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6841d55-a1bf-436a-9e38-c3ca9455e858 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:02.828622 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6841d55-a1bf-436a-9e38-c3ca9455e858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:02.830253 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6841d55-a1bf-436a-9e38-c3ca9455e858 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:02.844680 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1299/2654] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:07:02.846104 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e158a9b-d30b-4acc-baee-2b0a959a4e1f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:02.856986 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e158a9b-d30b-4acc-baee-2b0a959a4e1f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:02.861727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5c23-3aa2-4b77-a4b7-eaac259e035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:02.862635 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5c23-3aa2-4b77-a4b7-eaac259e035f admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:02.862917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5c23-3aa2-4b77-a4b7-eaac259e035f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:02.863554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5c23-3aa2-4b77-a4b7-eaac259e035f admin admin] PATH_INFO: `/v3/projects/b1a1f488fe454f719be74dfca7bc68ad/users/da222b8f7127407288b79f0dfe202470/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:02.878926 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d5c23-3aa2-4b77-a4b7-eaac259e035f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1f488fe454f719be74dfca7bc68ad, user_id=da222b8f7127407288b79f0dfe202470, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:02.881802 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d5c23-3aa2-4b77-a4b7-eaac259e035f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:02.954235 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1356/2655] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:07:02 2022] PUT /identity/v3/projects/b1a1f488fe454f719be74dfca7bc68ad/users/da222b8f7127407288b79f0dfe202470/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:02.958207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6841d55-a1bf-436a-9e38-c3ca9455e858 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:02.968658 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6841d55-a1bf-436a-9e38-c3ca9455e858 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:03.023462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded509b-b3ec-43d3-b006-18181f0997c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:03.024812 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded509b-b3ec-43d3-b006-18181f0997c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:03.025090 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded509b-b3ec-43d3-b006-18181f0997c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:03.025357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded509b-b3ec-43d3-b006-18181f0997c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:03.026089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded509b-b3ec-43d3-b006-18181f0997c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:03.027704 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded509b-b3ec-43d3-b006-18181f0997c2 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:03.036995 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1300/2656] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:07:03.041784 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5c23-3aa2-4b77-a4b7-eaac259e035f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:03.051767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5c23-3aa2-4b77-a4b7-eaac259e035f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:03.056701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0f6a4-2fad-41d8-9476-ef6cd4cb7ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:03.057628 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0f6a4-2fad-41d8-9476-ef6cd4cb7ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:03.057903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0f6a4-2fad-41d8-9476-ef6cd4cb7ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:03.058226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0f6a4-2fad-41d8-9476-ef6cd4cb7ae6 admin admin] PATH_INFO: `/v3/projects/b1a1f488fe454f719be74dfca7bc68ad/users/da222b8f7127407288b79f0dfe202470/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:03.060257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0f6a4-2fad-41d8-9476-ef6cd4cb7ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1f488fe454f719be74dfca7bc68ad, user_id=da222b8f7127407288b79f0dfe202470, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:03.065611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0f6a4-2fad-41d8-9476-ef6cd4cb7ae6 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:03.076083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1357/2657] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:07:03 2022] PUT /identity/v3/projects/b1a1f488fe454f719be74dfca7bc68ad/users/da222b8f7127407288b79f0dfe202470/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:03.087639 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ede97b-598d-433c-b1e7-4a2fc36e8e5f None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:03.087926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ede97b-598d-433c-b1e7-4a2fc36e8e5f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:03.090679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ede97b-598d-433c-b1e7-4a2fc36e8e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:03.114117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-16ede97b-598d-433c-b1e7-4a2fc36e8e5f None None] MFA Rules not processed for user `da222b8f7127407288b79f0dfe202470`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:03.115292 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-16ede97b-598d-433c-b1e7-4a2fc36e8e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:03.183531 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1301/2658] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:07:03.193964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0f6a4-2fad-41d8-9476-ef6cd4cb7ae6 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:03.196223 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0ff0f6a4-2fad-41d8-9476-ef6cd4cb7ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:03.251816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0f6a4-2fad-41d8-9476-ef6cd4cb7ae6 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:03.255583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca546-bb17-4f1c-b3b2-a776ff5475d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:03.256220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca546-bb17-4f1c-b3b2-a776ff5475d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:03.256499 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca546-bb17-4f1c-b3b2-a776ff5475d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:03.256768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ca546-bb17-4f1c-b3b2-a776ff5475d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:03.317294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ca546-bb17-4f1c-b3b2-a776ff5475d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:03.327806 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ca546-bb17-4f1c-b3b2-a776ff5475d7 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:03.328180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1358/2659] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:07.756739 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ede97b-598d-433c-b1e7-4a2fc36e8e5f None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:07.758169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-16ede97b-598d-433c-b1e7-4a2fc36e8e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:07.811725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ede97b-598d-433c-b1e7-4a2fc36e8e5f None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:07.815602 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd4f6-9641-4996-a7cf-0203a68440e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:07.816093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd4f6-9641-4996-a7cf-0203a68440e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:07.816375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd4f6-9641-4996-a7cf-0203a68440e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:07.816647 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd4f6-9641-4996-a7cf-0203a68440e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:07.818465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-e8fdd4f6-9641-4996-a7cf-0203a68440e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:07.881957 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd4f6-9641-4996-a7cf-0203a68440e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:07.883460 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd4f6-9641-4996-a7cf-0203a68440e9 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:07.894504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1302/2660] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:10.058571 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca546-bb17-4f1c-b3b2-a776ff5475d7 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:10.059986 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-883ca546-bb17-4f1c-b3b2-a776ff5475d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:10.142094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ca546-bb17-4f1c-b3b2-a776ff5475d7 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:10.170954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef988f73-e642-41f7-9e4f-3a522a9e0ff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:10.170954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef988f73-e642-41f7-9e4f-3a522a9e0ff5 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:10.170954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef988f73-e642-41f7-9e4f-3a522a9e0ff5 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:10.170954 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef988f73-e642-41f7-9e4f-3a522a9e0ff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:10.171376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ef988f73-e642-41f7-9e4f-3a522a9e0ff5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:10.171376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef988f73-e642-41f7-9e4f-3a522a9e0ff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:10.171376 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef988f73-e642-41f7-9e4f-3a522a9e0ff5 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:10.176465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1359/2661] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:12.803384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd4f6-9641-4996-a7cf-0203a68440e9 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:12.813083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd4f6-9641-4996-a7cf-0203a68440e9 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:12.816699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512f848-a918-4f43-acde-e616287ffea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:12.817333 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512f848-a918-4f43-acde-e616287ffea1 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:12.817611 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512f848-a918-4f43-acde-e616287ffea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:12.817884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512f848-a918-4f43-acde-e616287ffea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:12.827844 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512f848-a918-4f43-acde-e616287ffea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:12.829260 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512f848-a918-4f43-acde-e616287ffea1 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:12.838489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1303/2662] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:40.313238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fb725-8c9d-46bc-a114-9f26376ec375 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:40.319413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fb725-8c9d-46bc-a114-9f26376ec375 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:40.319413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fb725-8c9d-46bc-a114-9f26376ec375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:40.331524 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-9d4fb725-8c9d-46bc-a114-9f26376ec375 None None] MFA Rules not processed for user `7a4590988e5b499b8c2c4f9ecd3d05ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:40.332692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-9d4fb725-8c9d-46bc-a114-9f26376ec375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:40.385397 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1360/2663] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:07:40.631924 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512f848-a918-4f43-acde-e616287ffea1 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:40.641321 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512f848-a918-4f43-acde-e616287ffea1 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:40.644858 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4ea49-4490-4079-9aa6-b95061ff580d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:40.645479 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4ea49-4490-4079-9aa6-b95061ff580d service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:40.645752 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4ea49-4490-4079-9aa6-b95061ff580d service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:40.646047 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4ea49-4490-4079-9aa6-b95061ff580d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:40.647768 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a6e4ea49-4490-4079-9aa6-b95061ff580d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:40.656993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4ea49-4490-4079-9aa6-b95061ff580d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:40.658443 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4ea49-4490-4079-9aa6-b95061ff580d service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:40.666081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1304/2664] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:43.955006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fb725-8c9d-46bc-a114-9f26376ec375 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:44.014931 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fb725-8c9d-46bc-a114-9f26376ec375 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:44.019289 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:44.020210 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:44.020445 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:44.020710 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] PATH_INFO: `/v3/users/c4ef61518f6d475ea21d9b2ff64b0406` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:44.021894 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ef61518f6d475ea21d9b2ff64b0406)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:44.025072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:44.212466 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ef61518f6d475ea21d9b2ff64b0406'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:44.219081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ef61518f6d475ea21d9b2ff64b0406'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:44.289351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ef61518f6d475ea21d9b2ff64b0406'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:44.302631 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ef61518f6d475ea21d9b2ff64b0406'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:44.303345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ef61518f6d475ea21d9b2ff64b0406'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:44.310153 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1361/2665] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:07:43 2022] DELETE /identity/v3/users/c4ef61518f6d475ea21d9b2ff64b0406 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:44.315079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe72069-a496-428b-b087-a2d308981868 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:44.315674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe72069-a496-428b-b087-a2d308981868 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:44.315674 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe72069-a496-428b-b087-a2d308981868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:44.341071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-5fe72069-a496-428b-b087-a2d308981868 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:44.342382 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5fe72069-a496-428b-b087-a2d308981868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:44.403193 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1305/2666] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:07:44.413211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:44.414682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:44.472321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29286ba8-bfa7-4c86-a103-4379e52c45d7 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:44.475979 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb980e-d8a2-4405-9dd4-82070ed233cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:44.476614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb980e-d8a2-4405-9dd4-82070ed233cc service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:44.476889 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb980e-d8a2-4405-9dd4-82070ed233cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:44.477159 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb980e-d8a2-4405-9dd4-82070ed233cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:44.486875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb980e-d8a2-4405-9dd4-82070ed233cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:44.488294 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb980e-d8a2-4405-9dd4-82070ed233cc service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:44.497641 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1362/2667] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:44.663617 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe72069-a496-428b-b087-a2d308981868 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:44.665121 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5fe72069-a496-428b-b087-a2d308981868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:44.759035 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe72069-a496-428b-b087-a2d308981868 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:44.766550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97179f-8d8c-4c1b-b344-bc685625cad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:44.767208 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97179f-8d8c-4c1b-b344-bc685625cad1 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:44.767488 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97179f-8d8c-4c1b-b344-bc685625cad1 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:44.767750 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97179f-8d8c-4c1b-b344-bc685625cad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:44.769515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5b97179f-8d8c-4c1b-b344-bc685625cad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:44.783409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97179f-8d8c-4c1b-b344-bc685625cad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:44.784969 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97179f-8d8c-4c1b-b344-bc685625cad1 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:44.797058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1306/2668] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:45.000850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb980e-d8a2-4405-9dd4-82070ed233cc service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:45.002344 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fccb980e-d8a2-4405-9dd4-82070ed233cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:45.015278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb980e-d8a2-4405-9dd4-82070ed233cc service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:45.020398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:45.021234 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:45.021514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:45.021783 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] PATH_INFO: `/v3/projects/a8c4be36b2e54e4ebd8f87c7ab4a5e17` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:45.022984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c4be36b2e54e4ebd8f87c7ab4a5e17)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:45.024862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:45.147767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c4be36b2e54e4ebd8f87c7ab4a5e17', 'request_id': 'req-96cb373c-d5b3-44e5-85c6-95af26c56343'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:45.153955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c4be36b2e54e4ebd8f87c7ab4a5e17', 'request_id': 'req-96cb373c-d5b3-44e5-85c6-95af26c56343'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:45.232063 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c4be36b2e54e4ebd8f87c7ab4a5e17', 'request_id': 'req-96cb373c-d5b3-44e5-85c6-95af26c56343'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:45.242707 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] The token cache is being invalidate because project a8c4be36b2e54e4ebd8f87c7ab4a5e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:07:45.242991 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:45.243601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:45.245137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1363/2669] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:07:44 2022] DELETE /identity/v3/projects/a8c4be36b2e54e4ebd8f87c7ab4a5e17 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:45.249054 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97179f-8d8c-4c1b-b344-bc685625cad1 service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:45.259138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97179f-8d8c-4c1b-b344-bc685625cad1 service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:45.316579 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:45.317514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:45.317800 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:45.318106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] PATH_INFO: `/v3/users/da222b8f7127407288b79f0dfe202470` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:45.319344 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da222b8f7127407288b79f0dfe202470)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:45.321358 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:45.503525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da222b8f7127407288b79f0dfe202470'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:45.504174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da222b8f7127407288b79f0dfe202470'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:45.563550 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da222b8f7127407288b79f0dfe202470'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:45.571360 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da222b8f7127407288b79f0dfe202470'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:45.584841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d0c2ab2c-b0dc-443b-8aa5-5e1f096ad2e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da222b8f7127407288b79f0dfe202470'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:45.594227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1307/2670] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:07:45 2022] DELETE /identity/v3/users/da222b8f7127407288b79f0dfe202470 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:46.005370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:46.007040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:46.020043 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb373c-d5b3-44e5-85c6-95af26c56343 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:46.075965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:46.078667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:46.078878 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:46.079148 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] PATH_INFO: `/v3/projects/b1a1f488fe454f719be74dfca7bc68ad` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:46.080372 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a1f488fe454f719be74dfca7bc68ad)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:46.082293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:46.197529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a1f488fe454f719be74dfca7bc68ad', 'request_id': 'req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:46.203504 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a1f488fe454f719be74dfca7bc68ad', 'request_id': 'req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:46.254774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a1f488fe454f719be74dfca7bc68ad', 'request_id': 'req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:46.265446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] The token cache is being invalidate because project b1a1f488fe454f719be74dfca7bc68ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:07:46.265841 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:46.275059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-51d9012f-64bb-42e9-8e0a-e6e74ed875ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:46.275059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1364/2671] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:07:46 2022] DELETE /identity/v3/projects/b1a1f488fe454f719be74dfca7bc68ad => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:46.275316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15776-af19-4374-8315-34be41cb0436 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:46.275316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15776-af19-4374-8315-34be41cb0436 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:46.275316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15776-af19-4374-8315-34be41cb0436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:46.293640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8cc15776-af19-4374-8315-34be41cb0436 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:46.294846 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8cc15776-af19-4374-8315-34be41cb0436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:46.351434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1308/2672] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:07:46.360068 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a65999-ba63-4745-9e11-c8401d86ee4c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:46.361419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a65999-ba63-4745-9e11-c8401d86ee4c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:46.361419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a65999-ba63-4745-9e11-c8401d86ee4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:46.379816 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-13a65999-ba63-4745-9e11-c8401d86ee4c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:46.381044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-13a65999-ba63-4745-9e11-c8401d86ee4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:46.389451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1365/2673] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:07:46.393692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc15776-af19-4374-8315-34be41cb0436 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:46.403298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc15776-af19-4374-8315-34be41cb0436 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:46.408343 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707e3c4-c5e1-400c-a2f4-34920b22c4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:46.408984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707e3c4-c5e1-400c-a2f4-34920b22c4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:46.409263 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707e3c4-c5e1-400c-a2f4-34920b22c4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:46.409537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707e3c4-c5e1-400c-a2f4-34920b22c4c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:46.410306 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707e3c4-c5e1-400c-a2f4-34920b22c4c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:07:46.410606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707e3c4-c5e1-400c-a2f4-34920b22c4c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:46.412183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707e3c4-c5e1-400c-a2f4-34920b22c4c5 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:46.424027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1309/2674] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:07:46.428256 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a65999-ba63-4745-9e11-c8401d86ee4c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:46.437402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a65999-ba63-4745-9e11-c8401d86ee4c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:46.441975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a4d33-2336-47df-b249-07b7b27ee7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:46.442634 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a4d33-2336-47df-b249-07b7b27ee7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:46.442910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a4d33-2336-47df-b249-07b7b27ee7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:46.443202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a4d33-2336-47df-b249-07b7b27ee7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:46.443885 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a4d33-2336-47df-b249-07b7b27ee7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:46.445733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a4d33-2336-47df-b249-07b7b27ee7d3 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:46.582385 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1366/2675] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:07:46 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:07:46.586565 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707e3c4-c5e1-400c-a2f4-34920b22c4c5 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:46.596965 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707e3c4-c5e1-400c-a2f4-34920b22c4c5 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:46.649970 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb801b-ed8c-4ae8-a584-0dd4c76df09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:46.650590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb801b-ed8c-4ae8-a584-0dd4c76df09d admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:46.650872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb801b-ed8c-4ae8-a584-0dd4c76df09d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:46.651148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb801b-ed8c-4ae8-a584-0dd4c76df09d admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:46.651821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb801b-ed8c-4ae8-a584-0dd4c76df09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:46.653763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb801b-ed8c-4ae8-a584-0dd4c76df09d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:46.745886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1310/2676] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:07:46 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:07:46.750208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a4d33-2336-47df-b249-07b7b27ee7d3 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:46.760145 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a4d33-2336-47df-b249-07b7b27ee7d3 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:46.765237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667cf0-041a-4388-b0be-cb14e3c1f0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:46.765873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667cf0-041a-4388-b0be-cb14e3c1f0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:46.766183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667cf0-041a-4388-b0be-cb14e3c1f0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:46.766454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667cf0-041a-4388-b0be-cb14e3c1f0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:46.767200 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd667cf0-041a-4388-b0be-cb14e3c1f0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:46.768750 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd667cf0-041a-4388-b0be-cb14e3c1f0a2 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:46.778624 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1367/2677] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:07:46.783471 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb801b-ed8c-4ae8-a584-0dd4c76df09d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:46.793260 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb801b-ed8c-4ae8-a584-0dd4c76df09d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:46.798003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cca6b-7470-44e1-a561-9bf181d71ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:46.798661 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cca6b-7470-44e1-a561-9bf181d71ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:46.798940 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cca6b-7470-44e1-a561-9bf181d71ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:46.799212 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cca6b-7470-44e1-a561-9bf181d71ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:46.799929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cca6b-7470-44e1-a561-9bf181d71ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:46.801501 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cca6b-7470-44e1-a561-9bf181d71ce8 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:46.811108 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1311/2678] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:07:46.815173 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667cf0-041a-4388-b0be-cb14e3c1f0a2 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:46.825281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667cf0-041a-4388-b0be-cb14e3c1f0a2 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:46.830476 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fe488-1c3e-4a8e-9259-690c75c2f5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:46.831336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fe488-1c3e-4a8e-9259-690c75c2f5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:46.831616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fe488-1c3e-4a8e-9259-690c75c2f5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:46.831888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fe488-1c3e-4a8e-9259-690c75c2f5a0 admin admin] PATH_INFO: `/v3/projects/da162704a63c4acbb09e0194922005af/users/67491445ad6c41388d4c102ec61787f0/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:46.847463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fe488-1c3e-4a8e-9259-690c75c2f5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da162704a63c4acbb09e0194922005af, user_id=67491445ad6c41388d4c102ec61787f0, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:46.850143 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fe488-1c3e-4a8e-9259-690c75c2f5a0 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:46.923669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1368/2679] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:07:46 2022] PUT /identity/v3/projects/da162704a63c4acbb09e0194922005af/users/67491445ad6c41388d4c102ec61787f0/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:46.933806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d50dd1-f11e-4fac-a68a-9a076db1a49e None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:46.934209 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d50dd1-f11e-4fac-a68a-9a076db1a49e None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:46.934557 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d50dd1-f11e-4fac-a68a-9a076db1a49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:46.962384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-48d50dd1-f11e-4fac-a68a-9a076db1a49e None None] MFA Rules not processed for user `67491445ad6c41388d4c102ec61787f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:46.963679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-48d50dd1-f11e-4fac-a68a-9a076db1a49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:47.025984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1312/2680] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:07:47.030533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fe488-1c3e-4a8e-9259-690c75c2f5a0 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:47.090306 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fe488-1c3e-4a8e-9259-690c75c2f5a0 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:47.096659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50768d-03d9-4610-8221-b0b693998860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:47.097332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50768d-03d9-4610-8221-b0b693998860 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:47.097606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50768d-03d9-4610-8221-b0b693998860 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:47.097874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50768d-03d9-4610-8221-b0b693998860 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:47.098584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50768d-03d9-4610-8221-b0b693998860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:47.100449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50768d-03d9-4610-8221-b0b693998860 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:47.188419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1369/2681] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:07:47 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:07:47.192379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d50dd1-f11e-4fac-a68a-9a076db1a49e None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:47.203914 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d50dd1-f11e-4fac-a68a-9a076db1a49e None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:47.258034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206464e-aaf5-43a5-9a4e-1d051ed3e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:47.261711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206464e-aaf5-43a5-9a4e-1d051ed3e1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:47.261711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206464e-aaf5-43a5-9a4e-1d051ed3e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:47.261711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206464e-aaf5-43a5-9a4e-1d051ed3e1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:47.261711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206464e-aaf5-43a5-9a4e-1d051ed3e1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:47.262123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206464e-aaf5-43a5-9a4e-1d051ed3e1b2 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:47.334845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1313/2682] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:07:47 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:07:47.338763 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50768d-03d9-4610-8221-b0b693998860 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:47.348844 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50768d-03d9-4610-8221-b0b693998860 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:47.353465 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae372a13-1ece-44fe-918d-db7a71048cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:47.354156 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae372a13-1ece-44fe-918d-db7a71048cac admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:47.354437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae372a13-1ece-44fe-918d-db7a71048cac admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:47.354717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae372a13-1ece-44fe-918d-db7a71048cac admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:47.355436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae372a13-1ece-44fe-918d-db7a71048cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:47.357007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae372a13-1ece-44fe-918d-db7a71048cac admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:47.367686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1370/2683] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:07:47.371497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206464e-aaf5-43a5-9a4e-1d051ed3e1b2 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:47.382240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206464e-aaf5-43a5-9a4e-1d051ed3e1b2 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:47.386886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2361a27-d974-402e-9406-045a3bed8005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:47.387525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2361a27-d974-402e-9406-045a3bed8005 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:47.387802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2361a27-d974-402e-9406-045a3bed8005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:47.388071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2361a27-d974-402e-9406-045a3bed8005 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:47.388792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2361a27-d974-402e-9406-045a3bed8005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:47.390371 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2361a27-d974-402e-9406-045a3bed8005 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:47.399896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1314/2684] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:07:47.403993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae372a13-1ece-44fe-918d-db7a71048cac admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:47.413644 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae372a13-1ece-44fe-918d-db7a71048cac admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:47.418212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037d255-80e5-4323-84e9-93cb342ba8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:47.419073 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037d255-80e5-4323-84e9-93cb342ba8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:47.421089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037d255-80e5-4323-84e9-93cb342ba8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:47.421426 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037d255-80e5-4323-84e9-93cb342ba8f0 admin admin] PATH_INFO: `/v3/projects/b8bf73111d6948c38be913bf3a6def9d/users/00e96cad192d4dfa900f66bf1c28f1f0/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:47.435504 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037d255-80e5-4323-84e9-93cb342ba8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf73111d6948c38be913bf3a6def9d, user_id=00e96cad192d4dfa900f66bf1c28f1f0, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:47.438987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037d255-80e5-4323-84e9-93cb342ba8f0 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:47.511304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1371/2685] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:07:47 2022] PUT /identity/v3/projects/b8bf73111d6948c38be913bf3a6def9d/users/00e96cad192d4dfa900f66bf1c28f1f0/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:47.522173 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96d2d-7a4b-42b8-84eb-219b5dc0d83c None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:47.522464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96d2d-7a4b-42b8-84eb-219b5dc0d83c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:47.522740 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96d2d-7a4b-42b8-84eb-219b5dc0d83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:47.549295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-51d96d2d-7a4b-42b8-84eb-219b5dc0d83c None None] MFA Rules not processed for user `00e96cad192d4dfa900f66bf1c28f1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:47.550537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-51d96d2d-7a4b-42b8-84eb-219b5dc0d83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:47.611179 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1315/2686] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:07:47.615677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037d255-80e5-4323-84e9-93cb342ba8f0 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:47.673451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037d255-80e5-4323-84e9-93cb342ba8f0 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:47.678081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3fb5f-629e-47ea-afe3-918432cd46db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:47.678721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3fb5f-629e-47ea-afe3-918432cd46db admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:47.679005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3fb5f-629e-47ea-afe3-918432cd46db admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:47.679278 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3fb5f-629e-47ea-afe3-918432cd46db admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:47.679953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3fb5f-629e-47ea-afe3-918432cd46db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:47.681808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3fb5f-629e-47ea-afe3-918432cd46db admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:47.764059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1372/2687] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:07:47 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:07:47.767940 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96d2d-7a4b-42b8-84eb-219b5dc0d83c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:47.778304 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96d2d-7a4b-42b8-84eb-219b5dc0d83c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:47.836037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca433812-957d-4fc4-8603-fe78a22c330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:47.836713 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca433812-957d-4fc4-8603-fe78a22c330a admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:47.836991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca433812-957d-4fc4-8603-fe78a22c330a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:47.837273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca433812-957d-4fc4-8603-fe78a22c330a admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:47.837959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca433812-957d-4fc4-8603-fe78a22c330a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:47.839902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca433812-957d-4fc4-8603-fe78a22c330a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:47.929640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1316/2688] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:07:47 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:07:47.933711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3fb5f-629e-47ea-afe3-918432cd46db admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:47.944070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3fb5f-629e-47ea-afe3-918432cd46db admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:47.948888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923c8d2-14a9-4916-81aa-b96fd6f7f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:47.949564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923c8d2-14a9-4916-81aa-b96fd6f7f51f admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:47.949881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923c8d2-14a9-4916-81aa-b96fd6f7f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:47.950179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923c8d2-14a9-4916-81aa-b96fd6f7f51f admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:47.950891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923c8d2-14a9-4916-81aa-b96fd6f7f51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:47.952987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923c8d2-14a9-4916-81aa-b96fd6f7f51f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:47.962976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1373/2689] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:07:47.967821 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca433812-957d-4fc4-8603-fe78a22c330a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:47.977608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca433812-957d-4fc4-8603-fe78a22c330a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:47.982294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe007e-bc44-4a47-82e8-90be0bbac931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:47.983189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe007e-bc44-4a47-82e8-90be0bbac931 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:47.983468 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe007e-bc44-4a47-82e8-90be0bbac931 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:47.983744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe007e-bc44-4a47-82e8-90be0bbac931 admin admin] PATH_INFO: `/v3/projects/b8ff96c32f5441019462f9681bd91810/users/06ffe896dd044cc0b653af2b1bf6499a/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:47.997918 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe007e-bc44-4a47-82e8-90be0bbac931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ff96c32f5441019462f9681bd91810, user_id=06ffe896dd044cc0b653af2b1bf6499a, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:48.000765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe007e-bc44-4a47-82e8-90be0bbac931 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:48.089613 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1317/2690] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:07:47 2022] PUT /identity/v3/projects/b8ff96c32f5441019462f9681bd91810/users/06ffe896dd044cc0b653af2b1bf6499a/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:07:48.093967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923c8d2-14a9-4916-81aa-b96fd6f7f51f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:48.104169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923c8d2-14a9-4916-81aa-b96fd6f7f51f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:48.160084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0340d-ed6b-43d1-9c60-d0831bea6783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:48.160758 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0340d-ed6b-43d1-9c60-d0831bea6783 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:48.161044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0340d-ed6b-43d1-9c60-d0831bea6783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:48.161323 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0340d-ed6b-43d1-9c60-d0831bea6783 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:48.162081 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0340d-ed6b-43d1-9c60-d0831bea6783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:48.163652 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0340d-ed6b-43d1-9c60-d0831bea6783 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:48.173506 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1374/2691] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:07:48.177785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe007e-bc44-4a47-82e8-90be0bbac931 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:48.187938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe007e-bc44-4a47-82e8-90be0bbac931 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:48.192581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20144a65-2ddd-43f8-833e-4d7f5478af65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:48.193445 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20144a65-2ddd-43f8-833e-4d7f5478af65 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:48.193728 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20144a65-2ddd-43f8-833e-4d7f5478af65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:48.194034 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20144a65-2ddd-43f8-833e-4d7f5478af65 admin admin] PATH_INFO: `/v3/projects/b8ff96c32f5441019462f9681bd91810/users/06ffe896dd044cc0b653af2b1bf6499a/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:48.196004 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20144a65-2ddd-43f8-833e-4d7f5478af65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ff96c32f5441019462f9681bd91810, user_id=06ffe896dd044cc0b653af2b1bf6499a, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:48.198934 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20144a65-2ddd-43f8-833e-4d7f5478af65 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:48.209540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1318/2692] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:07:48 2022] PUT /identity/v3/projects/b8ff96c32f5441019462f9681bd91810/users/06ffe896dd044cc0b653af2b1bf6499a/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:48.220321 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6b616-6b68-4aa7-8627-5f063641651f None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:48.220604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6b616-6b68-4aa7-8627-5f063641651f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:48.220876 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6b616-6b68-4aa7-8627-5f063641651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:48.246140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d1a6b616-6b68-4aa7-8627-5f063641651f None None] MFA Rules not processed for user `06ffe896dd044cc0b653af2b1bf6499a`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:48.247449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d1a6b616-6b68-4aa7-8627-5f063641651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:48.312029 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1375/2693] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:07:48.322921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20144a65-2ddd-43f8-833e-4d7f5478af65 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:48.324729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-20144a65-2ddd-43f8-833e-4d7f5478af65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:48.380807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20144a65-2ddd-43f8-833e-4d7f5478af65 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:48.384515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4cffb-b267-4cdb-929f-0cbb2176a503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:48.385208 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cffb-b267-4cdb-929f-0cbb2176a503 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:48.385492 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cffb-b267-4cdb-929f-0cbb2176a503 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:48.385761 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4cffb-b267-4cdb-929f-0cbb2176a503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:48.395267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4cffb-b267-4cdb-929f-0cbb2176a503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:48.396739 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4cffb-b267-4cdb-929f-0cbb2176a503 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:48.406014 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1319/2694] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:49.312927 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6b616-6b68-4aa7-8627-5f063641651f None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:49.316252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d1a6b616-6b68-4aa7-8627-5f063641651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:49.331997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6b616-6b68-4aa7-8627-5f063641651f None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:49.336482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18886776-51bc-4215-8b94-5d7d35e40a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:49.337140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18886776-51bc-4215-8b94-5d7d35e40a7e service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:49.337637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18886776-51bc-4215-8b94-5d7d35e40a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:49.337916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18886776-51bc-4215-8b94-5d7d35e40a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:49.395347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18886776-51bc-4215-8b94-5d7d35e40a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:49.396921 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18886776-51bc-4215-8b94-5d7d35e40a7e service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:49.405950 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1376/2695] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:51.409896 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4cffb-b267-4cdb-929f-0cbb2176a503 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:51.411516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-30f4cffb-b267-4cdb-929f-0cbb2176a503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:51.488770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4cffb-b267-4cdb-929f-0cbb2176a503 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:51.494296 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f3e3a-3a5d-4970-bf01-2b0b50b73094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:51.494942 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f3e3a-3a5d-4970-bf01-2b0b50b73094 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:51.495223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f3e3a-3a5d-4970-bf01-2b0b50b73094 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:51.495496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f3e3a-3a5d-4970-bf01-2b0b50b73094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:51.497348 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-589f3e3a-3a5d-4970-bf01-2b0b50b73094 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:51.511563 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f3e3a-3a5d-4970-bf01-2b0b50b73094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:51.513148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f3e3a-3a5d-4970-bf01-2b0b50b73094 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:51.524909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1320/2696] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:54.257264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18886776-51bc-4215-8b94-5d7d35e40a7e service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:54.267219 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18886776-51bc-4215-8b94-5d7d35e40a7e service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:54.271065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67754105-4913-4730-8d13-caf211143877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:54.271705 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67754105-4913-4730-8d13-caf211143877 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:54.272336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67754105-4913-4730-8d13-caf211143877 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:54.272336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67754105-4913-4730-8d13-caf211143877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:54.328834 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67754105-4913-4730-8d13-caf211143877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:54.330290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67754105-4913-4730-8d13-caf211143877 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:54.339018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1377/2697] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:55.611075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dfb4c-0f68-43ce-a47a-47c8c8c269d9 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:55.611588 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dfb4c-0f68-43ce-a47a-47c8c8c269d9 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:55.611685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dfb4c-0f68-43ce-a47a-47c8c8c269d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:55.628282 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-723dfb4c-0f68-43ce-a47a-47c8c8c269d9 None None] MFA Rules not processed for user `7a4590988e5b499b8c2c4f9ecd3d05ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:55.629466 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-723dfb4c-0f68-43ce-a47a-47c8c8c269d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:55.683692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1321/2698] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:07:56.197225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67754105-4913-4730-8d13-caf211143877 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:56.198914 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-67754105-4913-4730-8d13-caf211143877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:56.255264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67754105-4913-4730-8d13-caf211143877 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:56.258884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd5cec-b7de-49cb-b822-2243c39d621b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:56.259509 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5cec-b7de-49cb-b822-2243c39d621b service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:56.259786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5cec-b7de-49cb-b822-2243c39d621b service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:56.260057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd5cec-b7de-49cb-b822-2243c39d621b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:56.261781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a3bd5cec-b7de-49cb-b822-2243c39d621b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:56.271659 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd5cec-b7de-49cb-b822-2243c39d621b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:56.273050 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd5cec-b7de-49cb-b822-2243c39d621b service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:56.281388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1378/2699] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:58.172620 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dfb4c-0f68-43ce-a47a-47c8c8c269d9 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:58.233915 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dfb4c-0f68-43ce-a47a-47c8c8c269d9 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:58.238513 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:58.239373 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:58.239648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:58.239920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] PATH_INFO: `/v3/users/67491445ad6c41388d4c102ec61787f0` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:58.241093 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] RBAC: Authorizing `identity:delete_user(user_id=67491445ad6c41388d4c102ec61787f0)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:58.243106 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:58.479496 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67491445ad6c41388d4c102ec61787f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:58.480157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67491445ad6c41388d4c102ec61787f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:58.557366 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67491445ad6c41388d4c102ec61787f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:58.564870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67491445ad6c41388d4c102ec61787f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:58.577084 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67491445ad6c41388d4c102ec61787f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:58.583476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1322/2700] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:07:58 2022] DELETE /identity/v3/users/67491445ad6c41388d4c102ec61787f0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:07:58.588103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4e13e-c014-4e14-8b2d-f6623001394f None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:58.588572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4e13e-c014-4e14-8b2d-f6623001394f None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:58.588686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4e13e-c014-4e14-8b2d-f6623001394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:58.605978 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4ec4e13e-c014-4e14-8b2d-f6623001394f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:07:58.607236 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4ec4e13e-c014-4e14-8b2d-f6623001394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:58.667069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1379/2701] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:07:58.676895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:58.678328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:58.736938 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34550c10-b350-4c6a-8b33-437e732bf60a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:58.740573 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f464ec-77e6-4765-95e6-f3761724470e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:58.741211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f464ec-77e6-4765-95e6-f3761724470e service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:58.741486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f464ec-77e6-4765-95e6-f3761724470e service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:58.741756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f464ec-77e6-4765-95e6-f3761724470e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:58.751065 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f464ec-77e6-4765-95e6-f3761724470e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:58.752473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f464ec-77e6-4765-95e6-f3761724470e service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:58.762260 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1323/2702] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:07:59.205070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4e13e-c014-4e14-8b2d-f6623001394f None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:59.206617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4ec4e13e-c014-4e14-8b2d-f6623001394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:07:59.225301 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4e13e-c014-4e14-8b2d-f6623001394f None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:59.231224 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:59.232347 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:59.232721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:59.233198 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] PATH_INFO: `/v3/projects/da162704a63c4acbb09e0194922005af` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:59.235487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da162704a63c4acbb09e0194922005af)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:59.237462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:59.351084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da162704a63c4acbb09e0194922005af', 'request_id': 'req-e4ffdc41-bb83-4bce-b9fb-5299dae71939'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:59.357169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da162704a63c4acbb09e0194922005af', 'request_id': 'req-e4ffdc41-bb83-4bce-b9fb-5299dae71939'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:59.420403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da162704a63c4acbb09e0194922005af', 'request_id': 'req-e4ffdc41-bb83-4bce-b9fb-5299dae71939'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:59.431842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] The token cache is being invalidate because project da162704a63c4acbb09e0194922005af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:07:59.432125 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:59.432764 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:59.434344 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1380/2703] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:07:59 2022] DELETE /identity/v3/projects/da162704a63c4acbb09e0194922005af => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:07:59.438956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f464ec-77e6-4765-95e6-f3761724470e service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:07:59.449273 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f464ec-77e6-4765-95e6-f3761724470e service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:07:59.515480 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:07:59.516547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:07:59.516926 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:07:59.517328 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] PATH_INFO: `/v3/users/00e96cad192d4dfa900f66bf1c28f1f0` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:07:59.519447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e96cad192d4dfa900f66bf1c28f1f0)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:07:59.521742 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:07:59.703650 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e96cad192d4dfa900f66bf1c28f1f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:59.704403 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e96cad192d4dfa900f66bf1c28f1f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:59.774764 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e96cad192d4dfa900f66bf1c28f1f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:59.782239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e96cad192d4dfa900f66bf1c28f1f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:59.793810 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e96cad192d4dfa900f66bf1c28f1f0'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:07:59.799897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1324/2704] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:07:59 2022] DELETE /identity/v3/users/00e96cad192d4dfa900f66bf1c28f1f0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:00.227773 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:00.232419 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:00.244299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffdc41-bb83-4bce-b9fb-5299dae71939 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:00.307713 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:00.308566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:00.308867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:00.309137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] PATH_INFO: `/v3/projects/b8bf73111d6948c38be913bf3a6def9d` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:00.310360 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8bf73111d6948c38be913bf3a6def9d)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:00.312271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:00.454992 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8bf73111d6948c38be913bf3a6def9d', 'request_id': 'req-62080483-870c-4d4f-8c08-454be1c3679b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:00.460884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8bf73111d6948c38be913bf3a6def9d', 'request_id': 'req-62080483-870c-4d4f-8c08-454be1c3679b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:00.540452 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8bf73111d6948c38be913bf3a6def9d', 'request_id': 'req-62080483-870c-4d4f-8c08-454be1c3679b'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:00.552980 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] The token cache is being invalidate because project b8bf73111d6948c38be913bf3a6def9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:08:00.553273 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:00.553949 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:00.555733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1381/2705] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:08:00 2022] DELETE /identity/v3/projects/b8bf73111d6948c38be913bf3a6def9d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:00.559619 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:00.561116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:00.574475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b40957-e7e0-4f73-97a5-82cc1e416882 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:00.630509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:00.631397 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:00.631675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:00.631946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] PATH_INFO: `/v3/users/06ffe896dd044cc0b653af2b1bf6499a` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:00.633146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ffe896dd044cc0b653af2b1bf6499a)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:00.635089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:00.835026 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ffe896dd044cc0b653af2b1bf6499a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:00.835743 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ffe896dd044cc0b653af2b1bf6499a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:00.912089 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ffe896dd044cc0b653af2b1bf6499a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:00.919582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ffe896dd044cc0b653af2b1bf6499a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:00.931822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-3924a180-061f-46b4-8fe4-f976ab0c1d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ffe896dd044cc0b653af2b1bf6499a'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:00.937805 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1325/2706] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:08:00 2022] DELETE /identity/v3/users/06ffe896dd044cc0b653af2b1bf6499a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:01.400069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:01.401602 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:01.415719 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080483-870c-4d4f-8c08-454be1c3679b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:01.474131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:01.474987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:01.475261 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:01.475583 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] PATH_INFO: `/v3/projects/b8ff96c32f5441019462f9681bd91810` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:01.476843 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ff96c32f5441019462f9681bd91810)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:01.478875 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:01.569122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ff96c32f5441019462f9681bd91810', 'request_id': 'req-e88c1285-234b-44c5-8da4-44b175eddabe'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:01.575375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ff96c32f5441019462f9681bd91810', 'request_id': 'req-e88c1285-234b-44c5-8da4-44b175eddabe'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:01.619771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ff96c32f5441019462f9681bd91810', 'request_id': 'req-e88c1285-234b-44c5-8da4-44b175eddabe'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:01.630082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] The token cache is being invalidate because project b8ff96c32f5441019462f9681bd91810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:08:01.630407 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:01.631018 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e88c1285-234b-44c5-8da4-44b175eddabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:01.632525 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1382/2707] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:08:01 2022] DELETE /identity/v3/projects/b8ff96c32f5441019462f9681bd91810 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:01.638769 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a0ef-5e6e-48d8-aad6-b94b9cbc5240 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:01.639255 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a0ef-5e6e-48d8-aad6-b94b9cbc5240 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:01.639352 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038a0ef-5e6e-48d8-aad6-b94b9cbc5240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:01.657427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8038a0ef-5e6e-48d8-aad6-b94b9cbc5240 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:08:01.658657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8038a0ef-5e6e-48d8-aad6-b94b9cbc5240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:01.715921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1326/2708] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:08:01.725329 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4c74b-4737-4480-bcb1-1bf986028d76 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:01.725612 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4c74b-4737-4480-bcb1-1bf986028d76 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:01.725886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4c74b-4737-4480-bcb1-1bf986028d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:01.744087 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-cfc4c74b-4737-4480-bcb1-1bf986028d76 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:08:01.745253 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-cfc4c74b-4737-4480-bcb1-1bf986028d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:01.753608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1383/2709] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:08:01.757665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a0ef-5e6e-48d8-aad6-b94b9cbc5240 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:01.767190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038a0ef-5e6e-48d8-aad6-b94b9cbc5240 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:01.771792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7dd43-20d1-4802-b839-54bd70da114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:01.772486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7dd43-20d1-4802-b839-54bd70da114a admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:01.772766 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7dd43-20d1-4802-b839-54bd70da114a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:01.773036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7dd43-20d1-4802-b839-54bd70da114a admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:01.773811 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7dd43-20d1-4802-b839-54bd70da114a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:08:01.774147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7dd43-20d1-4802-b839-54bd70da114a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:01.775806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7dd43-20d1-4802-b839-54bd70da114a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:01.787227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1327/2710] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:08:01.791310 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4c74b-4737-4480-bcb1-1bf986028d76 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:01.802993 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4c74b-4737-4480-bcb1-1bf986028d76 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:01.807655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb3b8-bc66-4934-a44a-408272072d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:01.808292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb3b8-bc66-4934-a44a-408272072d55 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:01.808568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb3b8-bc66-4934-a44a-408272072d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:01.808840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeb3b8-bc66-4934-a44a-408272072d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:01.809526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeb3b8-bc66-4934-a44a-408272072d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:01.811442 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeb3b8-bc66-4934-a44a-408272072d55 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:01.965012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1384/2711] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:08:01 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:08:01.971435 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7dd43-20d1-4802-b839-54bd70da114a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:01.981236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7dd43-20d1-4802-b839-54bd70da114a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:02.037822 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c61fbb-afc1-4fa7-a29d-a65fbf09b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:02.038516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61fbb-afc1-4fa7-a29d-a65fbf09b157 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.038796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61fbb-afc1-4fa7-a29d-a65fbf09b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.039070 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61fbb-afc1-4fa7-a29d-a65fbf09b157 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.039762 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c61fbb-afc1-4fa7-a29d-a65fbf09b157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:02.041682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c61fbb-afc1-4fa7-a29d-a65fbf09b157 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:02.105552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1328/2712] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:08:01 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:08:02.110258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb3b8-bc66-4934-a44a-408272072d55 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:02.120373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeb3b8-bc66-4934-a44a-408272072d55 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:02.125240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ba942-687c-4a38-ab16-b1d14cc2c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:02.125899 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ba942-687c-4a38-ab16-b1d14cc2c18e admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.126214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ba942-687c-4a38-ab16-b1d14cc2c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.126491 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ba942-687c-4a38-ab16-b1d14cc2c18e admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.127214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ba942-687c-4a38-ab16-b1d14cc2c18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:02.128799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ba942-687c-4a38-ab16-b1d14cc2c18e admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:02.139012 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1385/2713] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:08:02.143257 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c61fbb-afc1-4fa7-a29d-a65fbf09b157 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:02.152907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c61fbb-afc1-4fa7-a29d-a65fbf09b157 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:02.158135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb870a-1e4c-4c98-8cf4-5ab165af419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:02.158778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb870a-1e4c-4c98-8cf4-5ab165af419f admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.159056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb870a-1e4c-4c98-8cf4-5ab165af419f admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.159327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb870a-1e4c-4c98-8cf4-5ab165af419f admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.160043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb870a-1e4c-4c98-8cf4-5ab165af419f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:02.161675 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb870a-1e4c-4c98-8cf4-5ab165af419f admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:02.171847 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1329/2714] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:08:02.176270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ba942-687c-4a38-ab16-b1d14cc2c18e admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:02.186099 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ba942-687c-4a38-ab16-b1d14cc2c18e admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:02.190698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c09124-4cf8-4311-9c1c-823188da150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:02.191563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c09124-4cf8-4311-9c1c-823188da150d admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.191845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c09124-4cf8-4311-9c1c-823188da150d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.192118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c09124-4cf8-4311-9c1c-823188da150d admin admin] PATH_INFO: `/v3/projects/beb8b0cc3f8742ca93e70d567dc5c887/users/e59775eac1854601a34184a3285cbc05/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.206990 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c09124-4cf8-4311-9c1c-823188da150d admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb8b0cc3f8742ca93e70d567dc5c887, user_id=e59775eac1854601a34184a3285cbc05, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:02.209611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c09124-4cf8-4311-9c1c-823188da150d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:02.312517 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1386/2715] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:08:02 2022] PUT /identity/v3/projects/beb8b0cc3f8742ca93e70d567dc5c887/users/e59775eac1854601a34184a3285cbc05/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:02.324281 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62695fe-25cc-4e2a-9b7d-735691aa12f3 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.324572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62695fe-25cc-4e2a-9b7d-735691aa12f3 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.324872 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62695fe-25cc-4e2a-9b7d-735691aa12f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.354291 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f62695fe-25cc-4e2a-9b7d-735691aa12f3 None None] MFA Rules not processed for user `e59775eac1854601a34184a3285cbc05`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:08:02.355561 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f62695fe-25cc-4e2a-9b7d-735691aa12f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:02.421427 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1330/2716] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:08:02.425840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c09124-4cf8-4311-9c1c-823188da150d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:02.486671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c09124-4cf8-4311-9c1c-823188da150d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:02.491493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994a88c-ccd0-48a6-b792-a83f00bec544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:02.492138 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994a88c-ccd0-48a6-b792-a83f00bec544 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.492417 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994a88c-ccd0-48a6-b792-a83f00bec544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.492685 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994a88c-ccd0-48a6-b792-a83f00bec544 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.493375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994a88c-ccd0-48a6-b792-a83f00bec544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:02.495258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994a88c-ccd0-48a6-b792-a83f00bec544 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:02.575393 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1387/2717] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:08:02 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:08:02.580197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62695fe-25cc-4e2a-9b7d-735691aa12f3 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:02.590534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62695fe-25cc-4e2a-9b7d-735691aa12f3 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:02.644476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7cb33-0f71-4493-9234-1f77606e3b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:02.645150 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7cb33-0f71-4493-9234-1f77606e3b7e admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.645434 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7cb33-0f71-4493-9234-1f77606e3b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.646318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7cb33-0f71-4493-9234-1f77606e3b7e admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.646459 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7cb33-0f71-4493-9234-1f77606e3b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:02.648377 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7cb33-0f71-4493-9234-1f77606e3b7e admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:02.728487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1331/2718] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:08:02 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:08:02.732554 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994a88c-ccd0-48a6-b792-a83f00bec544 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:02.742859 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994a88c-ccd0-48a6-b792-a83f00bec544 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:02.747604 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a32831-7a33-41f3-a4d8-fe121beed30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:02.748251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a32831-7a33-41f3-a4d8-fe121beed30d admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.748551 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a32831-7a33-41f3-a4d8-fe121beed30d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.748820 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a32831-7a33-41f3-a4d8-fe121beed30d admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.750187 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a32831-7a33-41f3-a4d8-fe121beed30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:02.751961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a32831-7a33-41f3-a4d8-fe121beed30d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:02.761714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1388/2719] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:08:02.766319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7cb33-0f71-4493-9234-1f77606e3b7e admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:02.776204 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7cb33-0f71-4493-9234-1f77606e3b7e admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:02.781152 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0e86f-7c13-4e57-adec-d33ba033179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:02.782033 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0e86f-7c13-4e57-adec-d33ba033179a admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.782316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0e86f-7c13-4e57-adec-d33ba033179a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.782585 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0e86f-7c13-4e57-adec-d33ba033179a admin admin] PATH_INFO: `/v3/projects/1020b64683624aa09339f22e8ec3a852/users/72e7c03a1fbe446b903dee2216d945a6/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.796761 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0e86f-7c13-4e57-adec-d33ba033179a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1020b64683624aa09339f22e8ec3a852, user_id=72e7c03a1fbe446b903dee2216d945a6, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:02.799442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0e86f-7c13-4e57-adec-d33ba033179a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:02.865801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1332/2720] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:08:02 2022] PUT /identity/v3/projects/1020b64683624aa09339f22e8ec3a852/users/72e7c03a1fbe446b903dee2216d945a6/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:02.869819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a32831-7a33-41f3-a4d8-fe121beed30d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:02.879953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a32831-7a33-41f3-a4d8-fe121beed30d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:02.933451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d092f-dbc4-47a0-b541-c26c156caa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:02.934134 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d092f-dbc4-47a0-b541-c26c156caa52 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.934414 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d092f-dbc4-47a0-b541-c26c156caa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.934684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d092f-dbc4-47a0-b541-c26c156caa52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.935386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d092f-dbc4-47a0-b541-c26c156caa52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:02.937579 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d092f-dbc4-47a0-b541-c26c156caa52 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:02.947123 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1389/2721] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:08:02.951331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0e86f-7c13-4e57-adec-d33ba033179a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:02.961294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0e86f-7c13-4e57-adec-d33ba033179a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:02.966105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd29c1-b912-4465-a5f0-165f25482ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:02.967002 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd29c1-b912-4465-a5f0-165f25482ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.967277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd29c1-b912-4465-a5f0-165f25482ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.967546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd29c1-b912-4465-a5f0-165f25482ecc admin admin] PATH_INFO: `/v3/projects/1020b64683624aa09339f22e8ec3a852/users/72e7c03a1fbe446b903dee2216d945a6/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:02.969729 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd29c1-b912-4465-a5f0-165f25482ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1020b64683624aa09339f22e8ec3a852, user_id=72e7c03a1fbe446b903dee2216d945a6, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:02.972444 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd29c1-b912-4465-a5f0-165f25482ecc admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:02.982521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1333/2722] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:08:02 2022] PUT /identity/v3/projects/1020b64683624aa09339f22e8ec3a852/users/72e7c03a1fbe446b903dee2216d945a6/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:02.993082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81fa82-01c7-4970-8895-2430146f51b1 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:02.993367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81fa82-01c7-4970-8895-2430146f51b1 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:02.993638 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81fa82-01c7-4970-8895-2430146f51b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:03.019467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-de81fa82-01c7-4970-8895-2430146f51b1 None None] MFA Rules not processed for user `72e7c03a1fbe446b903dee2216d945a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:08:03.020654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-de81fa82-01c7-4970-8895-2430146f51b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:03.084072 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1390/2723] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:08:03.094987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd29c1-b912-4465-a5f0-165f25482ecc admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:03.096657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-14fd29c1-b912-4465-a5f0-165f25482ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:03.150379 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd29c1-b912-4465-a5f0-165f25482ecc admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:03.153973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf2e11-2f80-45ce-a7ca-624cd7668113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:03.154627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2e11-2f80-45ce-a7ca-624cd7668113 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:03.154903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2e11-2f80-45ce-a7ca-624cd7668113 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:03.155171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf2e11-2f80-45ce-a7ca-624cd7668113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:03.163770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf2e11-2f80-45ce-a7ca-624cd7668113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:03.165176 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf2e11-2f80-45ce-a7ca-624cd7668113 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:03.174785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1334/2724] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:08:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:08:03.305756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81fa82-01c7-4970-8895-2430146f51b1 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:03.366371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81fa82-01c7-4970-8895-2430146f51b1 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:03.370933 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:03.371785 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:03.372090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:03.372361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] PATH_INFO: `/v3/users/e59775eac1854601a34184a3285cbc05` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:03.373514 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59775eac1854601a34184a3285cbc05)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:03.375955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:03.548924 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59775eac1854601a34184a3285cbc05'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:03.555985 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59775eac1854601a34184a3285cbc05'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:03.642435 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59775eac1854601a34184a3285cbc05'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:03.654687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59775eac1854601a34184a3285cbc05'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:03.655361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59775eac1854601a34184a3285cbc05'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:03.661093 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1391/2725] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:08:03 2022] DELETE /identity/v3/users/e59775eac1854601a34184a3285cbc05 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:03.665598 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d76e6-9e7a-418d-aa7e-5593538063e0 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:03.666107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d76e6-9e7a-418d-aa7e-5593538063e0 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:03.666216 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d76e6-9e7a-418d-aa7e-5593538063e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:03.684097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-ed5d76e6-9e7a-418d-aa7e-5593538063e0 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:08:03.685278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ed5d76e6-9e7a-418d-aa7e-5593538063e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:03.741475 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1335/2726] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:08:03.752220 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:03.753697 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:03.808840 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b666a39-1433-4d01-9213-010b17f7dd8c admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:03.813318 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3939-d69e-4b00-b20e-491fb87bab21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:03.813948 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3939-d69e-4b00-b20e-491fb87bab21 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:03.814258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3939-d69e-4b00-b20e-491fb87bab21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:03.814529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3939-d69e-4b00-b20e-491fb87bab21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:03.824201 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3939-d69e-4b00-b20e-491fb87bab21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:03.825637 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3939-d69e-4b00-b20e-491fb87bab21 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:03.835258 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1392/2727] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:08:04.261610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d76e6-9e7a-418d-aa7e-5593538063e0 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:04.263124 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ed5d76e6-9e7a-418d-aa7e-5593538063e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:04.276845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d76e6-9e7a-418d-aa7e-5593538063e0 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:04.287228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:04.287228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:04.287228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:04.287228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] PATH_INFO: `/v3/projects/beb8b0cc3f8742ca93e70d567dc5c887` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:04.287980 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb8b0cc3f8742ca93e70d567dc5c887)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:04.287980 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:04.414223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb8b0cc3f8742ca93e70d567dc5c887', 'request_id': 'req-8e1415a1-44b3-424e-9d67-027e0a5039ff'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:04.420464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb8b0cc3f8742ca93e70d567dc5c887', 'request_id': 'req-8e1415a1-44b3-424e-9d67-027e0a5039ff'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:04.426684 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb8b0cc3f8742ca93e70d567dc5c887', 'request_id': 'req-8e1415a1-44b3-424e-9d67-027e0a5039ff'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:04.482110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] The token cache is being invalidate because project beb8b0cc3f8742ca93e70d567dc5c887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:08:04.482399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:04.483021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:04.484556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1336/2728] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:08:04 2022] DELETE /identity/v3/projects/beb8b0cc3f8742ca93e70d567dc5c887 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:04.488601 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3939-d69e-4b00-b20e-491fb87bab21 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:04.497869 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3939-d69e-4b00-b20e-491fb87bab21 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:04.552221 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:04.553006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:04.553285 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:04.553555 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] PATH_INFO: `/v3/users/72e7c03a1fbe446b903dee2216d945a6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:04.554772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e7c03a1fbe446b903dee2216d945a6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:04.556669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:04.737729 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e7c03a1fbe446b903dee2216d945a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:04.744544 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e7c03a1fbe446b903dee2216d945a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:04.831633 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e7c03a1fbe446b903dee2216d945a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:04.844052 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e7c03a1fbe446b903dee2216d945a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:04.844676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-458fb130-3073-4b8f-9a5d-bd1173713586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e7c03a1fbe446b903dee2216d945a6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:04.850570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1393/2729] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:08:04 2022] DELETE /identity/v3/users/72e7c03a1fbe446b903dee2216d945a6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:05.290472 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:05.292039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:05.305796 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1415a1-44b3-424e-9d67-027e0a5039ff admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:05.364205 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:05.365582 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:05.365869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:05.366189 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] PATH_INFO: `/v3/projects/1020b64683624aa09339f22e8ec3a852` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:05.367825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1020b64683624aa09339f22e8ec3a852)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:05.369725 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:05.500736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1020b64683624aa09339f22e8ec3a852', 'request_id': 'req-ca51cd73-95de-4c23-9f92-087dd7c811c7'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:05.506974 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1020b64683624aa09339f22e8ec3a852', 'request_id': 'req-ca51cd73-95de-4c23-9f92-087dd7c811c7'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:05.512529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1020b64683624aa09339f22e8ec3a852', 'request_id': 'req-ca51cd73-95de-4c23-9f92-087dd7c811c7'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:05.606166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] The token cache is being invalidate because project 1020b64683624aa09339f22e8ec3a852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:08:05.606166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:05.606166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-ca51cd73-95de-4c23-9f92-087dd7c811c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:05.606166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1337/2730] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:08:05 2022] DELETE /identity/v3/projects/1020b64683624aa09339f22e8ec3a852 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:08:05.609690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e1204-c874-4d11-934b-ffe38d99b720 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:05.610168 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e1204-c874-4d11-934b-ffe38d99b720 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:05.610332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e1204-c874-4d11-934b-ffe38d99b720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:05.628529 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0d1e1204-c874-4d11-934b-ffe38d99b720 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:08:05.629721 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0d1e1204-c874-4d11-934b-ffe38d99b720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:05.685031 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1394/2731] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:08:05.745307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446464a6-ae1e-4357-b1ab-8e2fb9111f41 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:05.745590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446464a6-ae1e-4357-b1ab-8e2fb9111f41 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:05.745897 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446464a6-ae1e-4357-b1ab-8e2fb9111f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:05.765464 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-446464a6-ae1e-4357-b1ab-8e2fb9111f41 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:08:05.766669 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-446464a6-ae1e-4357-b1ab-8e2fb9111f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:05.774421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1338/2732] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:08:05.778710 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e1204-c874-4d11-934b-ffe38d99b720 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:05.788283 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e1204-c874-4d11-934b-ffe38d99b720 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:05.792869 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50ae43-f3d9-47cf-a4d7-ec177f6054ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:05.793515 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ae43-f3d9-47cf-a4d7-ec177f6054ab admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:05.793796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ae43-f3d9-47cf-a4d7-ec177f6054ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:05.794109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50ae43-f3d9-47cf-a4d7-ec177f6054ab admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:05.794839 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50ae43-f3d9-47cf-a4d7-ec177f6054ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:08:05.795145 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50ae43-f3d9-47cf-a4d7-ec177f6054ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:05.796762 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50ae43-f3d9-47cf-a4d7-ec177f6054ab admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:05.808042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1395/2733] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:08:05.812596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446464a6-ae1e-4357-b1ab-8e2fb9111f41 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:05.821860 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446464a6-ae1e-4357-b1ab-8e2fb9111f41 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:05.826510 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426c62d-5f17-454b-adda-ade971194eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:05.827159 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426c62d-5f17-454b-adda-ade971194eda admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:05.828146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426c62d-5f17-454b-adda-ade971194eda admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:05.828489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426c62d-5f17-454b-adda-ade971194eda admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:05.829194 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426c62d-5f17-454b-adda-ade971194eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:05.831114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426c62d-5f17-454b-adda-ade971194eda admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:05.919072 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1339/2734] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:08:05 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:08:05.924464 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50ae43-f3d9-47cf-a4d7-ec177f6054ab admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:05.935203 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50ae43-f3d9-47cf-a4d7-ec177f6054ab admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:05.996626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4885ec7-a571-4074-96b0-79bf2c05802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:05.997384 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4885ec7-a571-4074-96b0-79bf2c05802d admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:05.997726 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4885ec7-a571-4074-96b0-79bf2c05802d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:05.998095 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4885ec7-a571-4074-96b0-79bf2c05802d admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:05.998845 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4885ec7-a571-4074-96b0-79bf2c05802d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:06.001708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4885ec7-a571-4074-96b0-79bf2c05802d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:06.106563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1396/2735] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:08:05 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:08:06.111224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426c62d-5f17-454b-adda-ade971194eda admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:06.121907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426c62d-5f17-454b-adda-ade971194eda admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:06.127136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe04d02-c8b2-4319-84a4-e03e8decf794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:06.127902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe04d02-c8b2-4319-84a4-e03e8decf794 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:06.128184 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe04d02-c8b2-4319-84a4-e03e8decf794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:06.128453 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe04d02-c8b2-4319-84a4-e03e8decf794 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:06.129166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe04d02-c8b2-4319-84a4-e03e8decf794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:06.130794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe04d02-c8b2-4319-84a4-e03e8decf794 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:06.140885 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1340/2736] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:08:06.144975 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4885ec7-a571-4074-96b0-79bf2c05802d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:06.155069 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4885ec7-a571-4074-96b0-79bf2c05802d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:06.160070 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ced8c-b33c-4050-906f-4b1d3c8ac1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:06.160732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ced8c-b33c-4050-906f-4b1d3c8ac1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:06.161008 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ced8c-b33c-4050-906f-4b1d3c8ac1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:06.161274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ced8c-b33c-4050-906f-4b1d3c8ac1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:06.162009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ced8c-b33c-4050-906f-4b1d3c8ac1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:06.163625 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ced8c-b33c-4050-906f-4b1d3c8ac1e7 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:06.176303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1397/2737] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:08:06.180596 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe04d02-c8b2-4319-84a4-e03e8decf794 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:06.191486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe04d02-c8b2-4319-84a4-e03e8decf794 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:06.196043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08ccf3-213d-411a-b898-e6108d3ff90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:06.197292 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08ccf3-213d-411a-b898-e6108d3ff90b admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:06.197570 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08ccf3-213d-411a-b898-e6108d3ff90b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:06.197838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08ccf3-213d-411a-b898-e6108d3ff90b admin admin] PATH_INFO: `/v3/projects/cf78b1e3e55e489f8fb6511958892143/users/19ad4863b3bc4d0b837f41622e2b336d/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:06.212046 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08ccf3-213d-411a-b898-e6108d3ff90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf78b1e3e55e489f8fb6511958892143, user_id=19ad4863b3bc4d0b837f41622e2b336d, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:06.214921 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08ccf3-213d-411a-b898-e6108d3ff90b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:06.312422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1341/2738] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:08:06 2022] PUT /identity/v3/projects/cf78b1e3e55e489f8fb6511958892143/users/19ad4863b3bc4d0b837f41622e2b336d/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:06.323196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf00f1-dfd0-44cf-8986-e00028f424ca None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:06.323479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf00f1-dfd0-44cf-8986-e00028f424ca None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:06.323747 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf00f1-dfd0-44cf-8986-e00028f424ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:06.349623 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-cddf00f1-dfd0-44cf-8986-e00028f424ca None None] MFA Rules not processed for user `19ad4863b3bc4d0b837f41622e2b336d`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:08:06.350860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-cddf00f1-dfd0-44cf-8986-e00028f424ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:06.414663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1398/2739] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:08:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:08:06.426238 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08ccf3-213d-411a-b898-e6108d3ff90b admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:06.427927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8f08ccf3-213d-411a-b898-e6108d3ff90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:06.483169 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08ccf3-213d-411a-b898-e6108d3ff90b admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:06.487481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaa936-a178-400c-b4a4-325912596c54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500eaf6aadff441ca1e535443e1d8c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:06.488116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaa936-a178-400c-b4a4-325912596c54 service glance] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:06.488393 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaa936-a178-400c-b4a4-325912596c54 service glance] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:06.488666 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaa936-a178-400c-b4a4-325912596c54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:06.496703 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcaa936-a178-400c-b4a4-325912596c54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:06.498140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcaa936-a178-400c-b4a4-325912596c54 service glance] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:06.506778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1342/2740] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:08:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:08:24.173767 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5e5d6-ced8-4541-af11-1bbc1cf8fef8 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:24.174359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5e5d6-ced8-4541-af11-1bbc1cf8fef8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:24.174359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5e5d6-ced8-4541-af11-1bbc1cf8fef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:24.201916 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-09b5e5d6-ced8-4541-af11-1bbc1cf8fef8 None None] MFA Rules not processed for user `7a4590988e5b499b8c2c4f9ecd3d05ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:08:24.203140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-09b5e5d6-ced8-4541-af11-1bbc1cf8fef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:24.271411 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1399/2741] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:08:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:08:35.028269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaa936-a178-400c-b4a4-325912596c54 service glance] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:35.127608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaa936-a178-400c-b4a4-325912596c54 service glance] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:35.132339 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:35.133192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:35.133466 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:35.133735 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] PATH_INFO: `/v3/users/19ad4863b3bc4d0b837f41622e2b336d` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:35.134946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ad4863b3bc4d0b837f41622e2b336d)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:35.136841 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:35.284572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ad4863b3bc4d0b837f41622e2b336d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:35.285237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ad4863b3bc4d0b837f41622e2b336d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:35.338507 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ad4863b3bc4d0b837f41622e2b336d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:35.345756 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ad4863b3bc4d0b837f41622e2b336d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:35.358797 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ad4863b3bc4d0b837f41622e2b336d'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:35.365555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1343/2742] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:08:35 2022] DELETE /identity/v3/users/19ad4863b3bc4d0b837f41622e2b336d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:08:35.370330 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef5ee-e412-46aa-bda3-17cd3c3c52d5 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:35.370852 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef5ee-e412-46aa-bda3-17cd3c3c52d5 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:35.370852 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef5ee-e412-46aa-bda3-17cd3c3c52d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:35.410369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-98fef5ee-e412-46aa-bda3-17cd3c3c52d5 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:08:35.412226 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-98fef5ee-e412-46aa-bda3-17cd3c3c52d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:35.468620 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1400/2743] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:08:35.479554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:35.481117 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:35.578473 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a22f78-306e-43b1-840e-21f8d61894cb admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:35.582071 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5847c-6ebb-42bc-baac-26d61e513fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:35.582709 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5847c-6ebb-42bc-baac-26d61e513fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:35.582985 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5847c-6ebb-42bc-baac-26d61e513fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:35.583799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5847c-6ebb-42bc-baac-26d61e513fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:35.592545 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5847c-6ebb-42bc-baac-26d61e513fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:35.593954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5847c-6ebb-42bc-baac-26d61e513fd0 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:35.603936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1344/2744] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:08:35.993003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef5ee-e412-46aa-bda3-17cd3c3c52d5 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:08:35.994619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-98fef5ee-e412-46aa-bda3-17cd3c3c52d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:08:36.008892 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef5ee-e412-46aa-bda3-17cd3c3c52d5 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:08:36.013676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:08:36.017010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:08:36.017010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:08:36.017010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] PATH_INFO: `/v3/projects/cf78b1e3e55e489f8fb6511958892143` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:08:36.017010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf78b1e3e55e489f8fb6511958892143)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:08:36.018178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:08:36.115096 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf78b1e3e55e489f8fb6511958892143', 'request_id': 'req-63c51996-30aa-4f0b-8bd5-bc6393e8697a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:36.121133 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf78b1e3e55e489f8fb6511958892143', 'request_id': 'req-63c51996-30aa-4f0b-8bd5-bc6393e8697a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:36.185180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf78b1e3e55e489f8fb6511958892143', 'request_id': 'req-63c51996-30aa-4f0b-8bd5-bc6393e8697a'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:36.197164 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] The token cache is being invalidate because project cf78b1e3e55e489f8fb6511958892143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:08:36.197451 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:36.198110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:08:36.199654 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1401/2745] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:08:35 2022] DELETE /identity/v3/projects/cf78b1e3e55e489f8fb6511958892143 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:13.555954 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5847c-6ebb-42bc-baac-26d61e513fd0 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:13.558288 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-7fd5847c-6ebb-42bc-baac-26d61e513fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:13.648340 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5847c-6ebb-42bc-baac-26d61e513fd0 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:13.708043 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d13a3b-41f4-4108-bbb4-2fed265c3c07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1875af7b72b247c9a2b5e1f2b2fb1eaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:13.708720 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d13a3b-41f4-4108-bbb4-2fed265c3c07 service placement] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:13.709022 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d13a3b-41f4-4108-bbb4-2fed265c3c07 service placement] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:13.709293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d13a3b-41f4-4108-bbb4-2fed265c3c07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:13.711098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c8d13a3b-41f4-4108-bbb4-2fed265c3c07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:13.722789 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d13a3b-41f4-4108-bbb4-2fed265c3c07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:13.724458 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d13a3b-41f4-4108-bbb4-2fed265c3c07 service placement] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:13.735024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1345/2746] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:09:15.663042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:15.664482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:15.726549 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c51996-30aa-4f0b-8bd5-bc6393e8697a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:15.732054 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:15.732921 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:15.733275 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:15.733565 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] PATH_INFO: `/v3/users/7a4590988e5b499b8c2c4f9ecd3d05ff` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:15.734768 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4590988e5b499b8c2c4f9ecd3d05ff)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:15.740308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:15.911213 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4590988e5b499b8c2c4f9ecd3d05ff'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:15.917669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4590988e5b499b8c2c4f9ecd3d05ff'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:15.995297 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4590988e5b499b8c2c4f9ecd3d05ff'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:16.007693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4590988e5b499b8c2c4f9ecd3d05ff'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:16.010488 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-544c5c38-3898-4c0a-8ae3-36ee28963f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4590988e5b499b8c2c4f9ecd3d05ff'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:16.014139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1402/2747] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:09:15 2022] DELETE /identity/v3/users/7a4590988e5b499b8c2c4f9ecd3d05ff => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:16.232151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d13a3b-41f4-4108-bbb4-2fed265c3c07 service placement] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:16.242524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d13a3b-41f4-4108-bbb4-2fed265c3c07 service placement] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:16.298039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:16.298903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:16.299185 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:16.299452 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] PATH_INFO: `/v3/projects/38c5deb84f8b4bfe855fe0e3b7ef6489` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:16.300629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c5deb84f8b4bfe855fe0e3b7ef6489)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:16.302558 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:16.416042 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c5deb84f8b4bfe855fe0e3b7ef6489', 'request_id': 'req-8e003998-66ad-4864-a263-b70d02920a6b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:16.425481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c5deb84f8b4bfe855fe0e3b7ef6489', 'request_id': 'req-8e003998-66ad-4864-a263-b70d02920a6b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:16.431195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c5deb84f8b4bfe855fe0e3b7ef6489', 'request_id': 'req-8e003998-66ad-4864-a263-b70d02920a6b'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:16.509534 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] The token cache is being invalidate because project 38c5deb84f8b4bfe855fe0e3b7ef6489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:09:16.509767 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:16.510350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8e003998-66ad-4864-a263-b70d02920a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:16.512514 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1346/2748] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:09:16 2022] DELETE /identity/v3/projects/38c5deb84f8b4bfe855fe0e3b7ef6489 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:16.518343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3868a-7ab4-4b7c-851e-d355f719a806 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:16.525182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3868a-7ab4-4b7c-851e-d355f719a806 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:16.525182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3868a-7ab4-4b7c-851e-d355f719a806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:16.565973 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4ba3868a-7ab4-4b7c-851e-d355f719a806 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:16.567264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4ba3868a-7ab4-4b7c-851e-d355f719a806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:16.625639 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1403/2749] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:16.633415 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bb4f2-489f-463d-9487-55d16eacb7d5 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:16.633777 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bb4f2-489f-463d-9487-55d16eacb7d5 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:16.634229 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bb4f2-489f-463d-9487-55d16eacb7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:16.653862 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-080bb4f2-489f-463d-9487-55d16eacb7d5 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:16.655092 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-080bb4f2-489f-463d-9487-55d16eacb7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:16.662892 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1347/2750] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:16.667094 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3868a-7ab4-4b7c-851e-d355f719a806 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:16.676858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3868a-7ab4-4b7c-851e-d355f719a806 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:16.681738 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94dd54-371d-4811-b751-527865f1b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:16.682456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94dd54-371d-4811-b751-527865f1b8fb admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:16.682734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94dd54-371d-4811-b751-527865f1b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:16.683005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94dd54-371d-4811-b751-527865f1b8fb admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:16.683789 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94dd54-371d-4811-b751-527865f1b8fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:09:16.684284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94dd54-371d-4811-b751-527865f1b8fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:16.685880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94dd54-371d-4811-b751-527865f1b8fb admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:16.697448 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1404/2751] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 28 22:09:16.702370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bb4f2-489f-463d-9487-55d16eacb7d5 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:16.711305 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bb4f2-489f-463d-9487-55d16eacb7d5 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:16.716616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf871467-b75e-47e1-8b46-ed809d3346f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:16.717268 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871467-b75e-47e1-8b46-ed809d3346f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:16.717543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871467-b75e-47e1-8b46-ed809d3346f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:16.717807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871467-b75e-47e1-8b46-ed809d3346f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:16.718524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf871467-b75e-47e1-8b46-ed809d3346f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:16.720406 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf871467-b75e-47e1-8b46-ed809d3346f2 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:16.819959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1348/2752] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:09:16 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:09:16.824643 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94dd54-371d-4811-b751-527865f1b8fb admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:16.835326 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94dd54-371d-4811-b751-527865f1b8fb admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:16.895037 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4c75b-3a91-4bec-878a-31c2a35fb235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:16.895717 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4c75b-3a91-4bec-878a-31c2a35fb235 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:16.896002 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4c75b-3a91-4bec-878a-31c2a35fb235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:16.896305 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4c75b-3a91-4bec-878a-31c2a35fb235 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:16.897009 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4c75b-3a91-4bec-878a-31c2a35fb235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:16.899010 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4c75b-3a91-4bec-878a-31c2a35fb235 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:17.007936 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1405/2753] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:09:16 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:09:17.012516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf871467-b75e-47e1-8b46-ed809d3346f2 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:17.022839 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf871467-b75e-47e1-8b46-ed809d3346f2 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:17.027888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cf089-46ec-4266-acc1-9333ddd0e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:17.028295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cf089-46ec-4266-acc1-9333ddd0e4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.028608 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cf089-46ec-4266-acc1-9333ddd0e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.028886 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cf089-46ec-4266-acc1-9333ddd0e4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.029724 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cf089-46ec-4266-acc1-9333ddd0e4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:17.032755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cf089-46ec-4266-acc1-9333ddd0e4e5 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:17.054614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1349/2754] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 22:09:17.055983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4c75b-3a91-4bec-878a-31c2a35fb235 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:17.066819 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4c75b-3a91-4bec-878a-31c2a35fb235 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:17.071780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d37af0-6f26-4d37-80d2-331a42070b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:17.072537 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37af0-6f26-4d37-80d2-331a42070b11 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.072881 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37af0-6f26-4d37-80d2-331a42070b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.073217 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37af0-6f26-4d37-80d2-331a42070b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.074027 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d37af0-6f26-4d37-80d2-331a42070b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:17.076462 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d37af0-6f26-4d37-80d2-331a42070b11 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:17.086484 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1406/2755] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:17.091405 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cf089-46ec-4266-acc1-9333ddd0e4e5 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:17.101195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cf089-46ec-4266-acc1-9333ddd0e4e5 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:17.106786 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f05ab-9aef-4010-a9bc-438ac57dcb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:17.107672 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f05ab-9aef-4010-a9bc-438ac57dcb58 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.107956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f05ab-9aef-4010-a9bc-438ac57dcb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.108234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f05ab-9aef-4010-a9bc-438ac57dcb58 admin admin] PATH_INFO: `/v3/projects/9da0c3c4c315408cbf9275a0011931f5/users/de07301f9bc347b3adf95e3ea4af4dec/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.124511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f05ab-9aef-4010-a9bc-438ac57dcb58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da0c3c4c315408cbf9275a0011931f5, user_id=de07301f9bc347b3adf95e3ea4af4dec, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:17.127195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f05ab-9aef-4010-a9bc-438ac57dcb58 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:17.193572 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1350/2756] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:09:17 2022] PUT /identity/v3/projects/9da0c3c4c315408cbf9275a0011931f5/users/de07301f9bc347b3adf95e3ea4af4dec/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:17.204716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c604c-6ce6-4f2a-b10c-d79ad01ec0bd None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.205005 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c604c-6ce6-4f2a-b10c-d79ad01ec0bd None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.205280 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c604c-6ce6-4f2a-b10c-d79ad01ec0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.230976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-815c604c-6ce6-4f2a-b10c-d79ad01ec0bd None None] MFA Rules not processed for user `de07301f9bc347b3adf95e3ea4af4dec`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:17.232233 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-815c604c-6ce6-4f2a-b10c-d79ad01ec0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:17.294388 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1407/2757] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:17.298882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f05ab-9aef-4010-a9bc-438ac57dcb58 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:17.359064 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f05ab-9aef-4010-a9bc-438ac57dcb58 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:17.365359 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f575bfa-6b6a-4fe0-8d4d-3b8e2adf108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:17.366039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f575bfa-6b6a-4fe0-8d4d-3b8e2adf108a admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.366333 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f575bfa-6b6a-4fe0-8d4d-3b8e2adf108a admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.366609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f575bfa-6b6a-4fe0-8d4d-3b8e2adf108a admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.367295 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f575bfa-6b6a-4fe0-8d4d-3b8e2adf108a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:17.369357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f575bfa-6b6a-4fe0-8d4d-3b8e2adf108a admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:17.481965 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1351/2758] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:09:17 2022] POST /identity/v3/projects => generated 393 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:09:17.486079 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c604c-6ce6-4f2a-b10c-d79ad01ec0bd None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:17.496860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c604c-6ce6-4f2a-b10c-d79ad01ec0bd None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:17.550790 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b062c-851c-4f59-a367-7010f644d3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:17.551446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b062c-851c-4f59-a367-7010f644d3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.551748 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b062c-851c-4f59-a367-7010f644d3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.552024 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b062c-851c-4f59-a367-7010f644d3d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.552712 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b062c-851c-4f59-a367-7010f644d3d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:17.554647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b062c-851c-4f59-a367-7010f644d3d9 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:17.622443 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1408/2759] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:09:17 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:09:17.626386 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f575bfa-6b6a-4fe0-8d4d-3b8e2adf108a admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:17.637032 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f575bfa-6b6a-4fe0-8d4d-3b8e2adf108a admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:17.642278 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7d2b1-4f6e-4777-8708-6a47545b2cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:17.642930 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7d2b1-4f6e-4777-8708-6a47545b2cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.643210 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7d2b1-4f6e-4777-8708-6a47545b2cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.643498 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7d2b1-4f6e-4777-8708-6a47545b2cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.644228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7d2b1-4f6e-4777-8708-6a47545b2cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:17.645804 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7d2b1-4f6e-4777-8708-6a47545b2cf2 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:17.656912 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1352/2760] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:17.660895 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b062c-851c-4f59-a367-7010f644d3d9 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:17.671740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b062c-851c-4f59-a367-7010f644d3d9 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:17.676375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a590-98e2-48b8-a027-9314395e1f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:17.677242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a590-98e2-48b8-a027-9314395e1f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.677553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a590-98e2-48b8-a027-9314395e1f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.677828 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953a590-98e2-48b8-a027-9314395e1f2f admin admin] PATH_INFO: `/v3/projects/ac1121df3c354c2893a398f935e79899/users/08800f5449404976b3f0b22bf9449aa2/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.692689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953a590-98e2-48b8-a027-9314395e1f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1121df3c354c2893a398f935e79899, user_id=08800f5449404976b3f0b22bf9449aa2, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:17.695632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953a590-98e2-48b8-a027-9314395e1f2f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:17.760681 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1409/2761] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:09:17 2022] PUT /identity/v3/projects/ac1121df3c354c2893a398f935e79899/users/08800f5449404976b3f0b22bf9449aa2/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:17.764765 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7d2b1-4f6e-4777-8708-6a47545b2cf2 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:17.774493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7d2b1-4f6e-4777-8708-6a47545b2cf2 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:17.829197 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100deb6-7890-4305-81c0-c5123a87cf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:17.829863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100deb6-7890-4305-81c0-c5123a87cf91 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.830180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100deb6-7890-4305-81c0-c5123a87cf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.830463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100deb6-7890-4305-81c0-c5123a87cf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.831170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100deb6-7890-4305-81c0-c5123a87cf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:17.832757 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100deb6-7890-4305-81c0-c5123a87cf91 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:17.843285 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1353/2762] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:17.847621 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a590-98e2-48b8-a027-9314395e1f2f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:17.858345 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953a590-98e2-48b8-a027-9314395e1f2f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:17.862929 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e56d-66df-4648-9952-e75debff2167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:17.863805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e56d-66df-4648-9952-e75debff2167 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.864083 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e56d-66df-4648-9952-e75debff2167 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.864353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e56d-66df-4648-9952-e75debff2167 admin admin] PATH_INFO: `/v3/projects/ac1121df3c354c2893a398f935e79899/users/08800f5449404976b3f0b22bf9449aa2/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.866371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e56d-66df-4648-9952-e75debff2167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1121df3c354c2893a398f935e79899, user_id=08800f5449404976b3f0b22bf9449aa2, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:17.868995 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e56d-66df-4648-9952-e75debff2167 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:17.879183 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1410/2763] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:09:17 2022] PUT /identity/v3/projects/ac1121df3c354c2893a398f935e79899/users/08800f5449404976b3f0b22bf9449aa2/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:17.890307 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f6d0d-4144-4802-837a-5501894a0d87 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:17.890603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f6d0d-4144-4802-837a-5501894a0d87 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:17.890880 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f6d0d-4144-4802-837a-5501894a0d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:17.917015 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-145f6d0d-4144-4802-837a-5501894a0d87 None None] MFA Rules not processed for user `08800f5449404976b3f0b22bf9449aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:17.918850 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-145f6d0d-4144-4802-837a-5501894a0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:17.984998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1354/2764] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:09:17.995553 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e56d-66df-4648-9952-e75debff2167 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:17.997367 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-05e8e56d-66df-4648-9952-e75debff2167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:18.072225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e56d-66df-4648-9952-e75debff2167 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:18.076584 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2a22f-92b4-432e-8f7d-4e5408019046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:18.077218 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2a22f-92b4-432e-8f7d-4e5408019046 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:18.077502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2a22f-92b4-432e-8f7d-4e5408019046 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:18.077769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2a22f-92b4-432e-8f7d-4e5408019046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:18.086495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2a22f-92b4-432e-8f7d-4e5408019046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:18.087947 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e2a22f-92b4-432e-8f7d-4e5408019046 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:18.097568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1411/2765] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:09:18.139655 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f6d0d-4144-4802-837a-5501894a0d87 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:18.141039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-145f6d0d-4144-4802-837a-5501894a0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:18.153783 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f6d0d-4144-4802-837a-5501894a0d87 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:18.157431 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58277d1-d689-4722-ba5d-34ad26077cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:18.158118 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58277d1-d689-4722-ba5d-34ad26077cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:18.158398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58277d1-d689-4722-ba5d-34ad26077cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:18.158672 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58277d1-d689-4722-ba5d-34ad26077cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:18.212109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58277d1-d689-4722-ba5d-34ad26077cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:18.213540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58277d1-d689-4722-ba5d-34ad26077cd0 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:18.223141 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1355/2766] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:09:22.886808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2a22f-92b4-432e-8f7d-4e5408019046 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:22.945863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2a22f-92b4-432e-8f7d-4e5408019046 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:22.950400 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:22.951251 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:22.951533 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:22.951803 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] PATH_INFO: `/v3/users/de07301f9bc347b3adf95e3ea4af4dec` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:22.952984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de07301f9bc347b3adf95e3ea4af4dec)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:22.955655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:23.126911 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de07301f9bc347b3adf95e3ea4af4dec'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:23.133481 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de07301f9bc347b3adf95e3ea4af4dec'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:23.190003 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de07301f9bc347b3adf95e3ea4af4dec'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:23.201866 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de07301f9bc347b3adf95e3ea4af4dec'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:23.202523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de07301f9bc347b3adf95e3ea4af4dec'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:23.208608 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1412/2767] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:09:22 2022] DELETE /identity/v3/users/de07301f9bc347b3adf95e3ea4af4dec => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:23.213180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b676f9-fe13-432f-892a-f12ee46e0e39 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:23.213645 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b676f9-fe13-432f-892a-f12ee46e0e39 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:23.213759 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b676f9-fe13-432f-892a-f12ee46e0e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:23.230744 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-12b676f9-fe13-432f-892a-f12ee46e0e39 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:23.231976 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-12b676f9-fe13-432f-892a-f12ee46e0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:23.289401 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1356/2768] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:23.299858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:23.305677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:23.356738 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6f618-c0e0-4eeb-b41d-e163ea653de4 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:23.361112 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957eae10-8ed2-48ce-852b-5ff4ea1a2748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:23.361740 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957eae10-8ed2-48ce-852b-5ff4ea1a2748 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:23.362042 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957eae10-8ed2-48ce-852b-5ff4ea1a2748 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:23.362315 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957eae10-8ed2-48ce-852b-5ff4ea1a2748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:23.371351 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957eae10-8ed2-48ce-852b-5ff4ea1a2748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:23.372801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957eae10-8ed2-48ce-852b-5ff4ea1a2748 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:23.382897 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1413/2769] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:09:23.794755 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b676f9-fe13-432f-892a-f12ee46e0e39 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:23.796180 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-12b676f9-fe13-432f-892a-f12ee46e0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:23.808958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b676f9-fe13-432f-892a-f12ee46e0e39 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:23.818685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:23.818685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:23.818685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:23.818685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] PATH_INFO: `/v3/projects/9da0c3c4c315408cbf9275a0011931f5` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:23.819168 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da0c3c4c315408cbf9275a0011931f5)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:23.819941 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:23.932136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da0c3c4c315408cbf9275a0011931f5', 'request_id': 'req-bc61664d-b1aa-4f9d-b786-21df2501de73'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:23.938066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da0c3c4c315408cbf9275a0011931f5', 'request_id': 'req-bc61664d-b1aa-4f9d-b786-21df2501de73'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:23.943809 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da0c3c4c315408cbf9275a0011931f5', 'request_id': 'req-bc61664d-b1aa-4f9d-b786-21df2501de73'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:24.021233 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] The token cache is being invalidate because project 9da0c3c4c315408cbf9275a0011931f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:09:24.021526 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:24.022176 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:24.023736 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1357/2770] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:09:23 2022] DELETE /identity/v3/projects/9da0c3c4c315408cbf9275a0011931f5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:09:24.027728 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957eae10-8ed2-48ce-852b-5ff4ea1a2748 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:24.038171 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957eae10-8ed2-48ce-852b-5ff4ea1a2748 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:24.092807 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:24.093669 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:24.093942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:24.094394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] PATH_INFO: `/v3/users/08800f5449404976b3f0b22bf9449aa2` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:24.096091 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08800f5449404976b3f0b22bf9449aa2)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:24.098004 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:24.281006 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08800f5449404976b3f0b22bf9449aa2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:24.287498 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08800f5449404976b3f0b22bf9449aa2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:24.364522 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08800f5449404976b3f0b22bf9449aa2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:24.377734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08800f5449404976b3f0b22bf9449aa2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:24.378437 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1cb2204b-c5e3-4803-b794-d3034a30afb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08800f5449404976b3f0b22bf9449aa2'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:24.384197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1414/2771] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:09:24 2022] DELETE /identity/v3/users/08800f5449404976b3f0b22bf9449aa2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:24.810192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:24.810192 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:24.825516 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61664d-b1aa-4f9d-b786-21df2501de73 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:24.882037 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:24.882944 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:24.883236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:24.883509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] PATH_INFO: `/v3/projects/ac1121df3c354c2893a398f935e79899` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:24.884677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1121df3c354c2893a398f935e79899)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:24.886609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:25.011499 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1121df3c354c2893a398f935e79899', 'request_id': 'req-76f11447-4a9e-4cee-b568-dead2b9cd230'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:25.017648 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1121df3c354c2893a398f935e79899', 'request_id': 'req-76f11447-4a9e-4cee-b568-dead2b9cd230'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:25.022879 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1121df3c354c2893a398f935e79899', 'request_id': 'req-76f11447-4a9e-4cee-b568-dead2b9cd230'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:25.097806 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] The token cache is being invalidate because project ac1121df3c354c2893a398f935e79899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:09:25.098123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:25.098737 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-76f11447-4a9e-4cee-b568-dead2b9cd230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:25.100280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1358/2772] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:09:24 2022] DELETE /identity/v3/projects/ac1121df3c354c2893a398f935e79899 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:25.105199 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ba055-49dc-46a7-bf8d-790de450c0dc None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:25.107824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ba055-49dc-46a7-bf8d-790de450c0dc None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:25.107824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ba055-49dc-46a7-bf8d-790de450c0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:25.125941 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-246ba055-49dc-46a7-bf8d-790de450c0dc None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:25.127304 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-246ba055-49dc-46a7-bf8d-790de450c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:25.183833 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1415/2773] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:25.191830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c47c-2e51-4689-8263-23b69cd1a767 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:25.192114 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c47c-2e51-4689-8263-23b69cd1a767 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:25.192384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c47c-2e51-4689-8263-23b69cd1a767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:25.210451 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-9914c47c-2e51-4689-8263-23b69cd1a767 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:25.211629 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-9914c47c-2e51-4689-8263-23b69cd1a767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:25.220036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1359/2774] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:25.223910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ba055-49dc-46a7-bf8d-790de450c0dc None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:25.233245 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ba055-49dc-46a7-bf8d-790de450c0dc None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:25.238380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc7278-d4c9-43ce-a693-94b070ea7681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:25.239017 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc7278-d4c9-43ce-a693-94b070ea7681 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:25.239295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc7278-d4c9-43ce-a693-94b070ea7681 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:25.239567 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc7278-d4c9-43ce-a693-94b070ea7681 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:25.240313 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc7278-d4c9-43ce-a693-94b070ea7681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:09:25.240619 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc7278-d4c9-43ce-a693-94b070ea7681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:25.242212 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc7278-d4c9-43ce-a693-94b070ea7681 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:25.253369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1416/2775] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:09:25.257370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914c47c-2e51-4689-8263-23b69cd1a767 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:25.266240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914c47c-2e51-4689-8263-23b69cd1a767 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:25.270834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b634c3-d9d9-44b9-b0b5-5becc47ceb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:25.271467 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b634c3-d9d9-44b9-b0b5-5becc47ceb45 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:25.271745 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b634c3-d9d9-44b9-b0b5-5becc47ceb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:25.272017 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b634c3-d9d9-44b9-b0b5-5becc47ceb45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:25.272691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b634c3-d9d9-44b9-b0b5-5becc47ceb45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:25.274637 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b634c3-d9d9-44b9-b0b5-5becc47ceb45 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:25.368961 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1360/2776] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:09:25 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:09:25.373241 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc7278-d4c9-43ce-a693-94b070ea7681 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:25.383387 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc7278-d4c9-43ce-a693-94b070ea7681 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:25.437879 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6b941-8ccb-40fd-b691-46f103b5eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:25.438568 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6b941-8ccb-40fd-b691-46f103b5eb96 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:25.438848 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6b941-8ccb-40fd-b691-46f103b5eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:25.439270 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6b941-8ccb-40fd-b691-46f103b5eb96 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:25.439983 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6b941-8ccb-40fd-b691-46f103b5eb96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:25.441886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6b941-8ccb-40fd-b691-46f103b5eb96 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:25.514920 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1417/2777] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:09:25 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:09:25.520066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b634c3-d9d9-44b9-b0b5-5becc47ceb45 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:25.530097 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b634c3-d9d9-44b9-b0b5-5becc47ceb45 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:25.535409 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a9594-b7a3-4da2-aafd-a43605bfb5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:25.536061 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a9594-b7a3-4da2-aafd-a43605bfb5cf admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:25.536341 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a9594-b7a3-4da2-aafd-a43605bfb5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:25.536613 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a9594-b7a3-4da2-aafd-a43605bfb5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:25.537337 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a9594-b7a3-4da2-aafd-a43605bfb5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:25.538950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a9594-b7a3-4da2-aafd-a43605bfb5cf admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:25.550574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1361/2778] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:25.554689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6b941-8ccb-40fd-b691-46f103b5eb96 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:25.564955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6b941-8ccb-40fd-b691-46f103b5eb96 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:25.569905 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5384e44-2733-4431-889b-048f186bae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:25.570588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5384e44-2733-4431-889b-048f186bae3a admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:25.570927 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5384e44-2733-4431-889b-048f186bae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:25.571187 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5384e44-2733-4431-889b-048f186bae3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:25.571907 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5384e44-2733-4431-889b-048f186bae3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:25.573482 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5384e44-2733-4431-889b-048f186bae3a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:25.584316 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1418/2779] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:25.588226 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a9594-b7a3-4da2-aafd-a43605bfb5cf admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:25.598977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a9594-b7a3-4da2-aafd-a43605bfb5cf admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:25.603663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b93cf2-1ba0-41e0-b222-cb9c4b87bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:25.604528 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b93cf2-1ba0-41e0-b222-cb9c4b87bffd admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:25.604833 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b93cf2-1ba0-41e0-b222-cb9c4b87bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:25.605104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b93cf2-1ba0-41e0-b222-cb9c4b87bffd admin admin] PATH_INFO: `/v3/projects/8870157c806544a9a3a1f11176fcaa52/users/1f52907a100848748926f974781599b7/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:25.619236 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b93cf2-1ba0-41e0-b222-cb9c4b87bffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8870157c806544a9a3a1f11176fcaa52, user_id=1f52907a100848748926f974781599b7, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:25.621825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b93cf2-1ba0-41e0-b222-cb9c4b87bffd admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:25.696457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1362/2780] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:09:25 2022] PUT /identity/v3/projects/8870157c806544a9a3a1f11176fcaa52/users/1f52907a100848748926f974781599b7/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:09:25.701453 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf28f8-d552-4d96-8b2b-8fc1cede9ac8 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:25.701737 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf28f8-d552-4d96-8b2b-8fc1cede9ac8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:25.702036 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf28f8-d552-4d96-8b2b-8fc1cede9ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:25.719193 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-3faf28f8-d552-4d96-8b2b-8fc1cede9ac8 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:25.720885 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3faf28f8-d552-4d96-8b2b-8fc1cede9ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:25.776623 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1419/2781] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:25.786713 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b93cf2-1ba0-41e0-b222-cb9c4b87bffd admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:25.788420 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-56b93cf2-1ba0-41e0-b222-cb9c4b87bffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:25.844669 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b93cf2-1ba0-41e0-b222-cb9c4b87bffd admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:25.848719 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4845ab1-001b-4fdd-b8a3-13152b284e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:25.849357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4845ab1-001b-4fdd-b8a3-13152b284e8b service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:25.849640 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4845ab1-001b-4fdd-b8a3-13152b284e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:25.849916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4845ab1-001b-4fdd-b8a3-13152b284e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:25.859793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4845ab1-001b-4fdd-b8a3-13152b284e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:25.861314 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4845ab1-001b-4fdd-b8a3-13152b284e8b service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:25.870677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1363/2782] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 22:09:27.044979 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673aa1-2956-4425-a420-e76639aa4dae None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:27.049521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673aa1-2956-4425-a420-e76639aa4dae None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:27.049521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52673aa1-2956-4425-a420-e76639aa4dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:27.072867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-52673aa1-2956-4425-a420-e76639aa4dae None None] MFA Rules not processed for user `1f52907a100848748926f974781599b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:27.074119 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-52673aa1-2956-4425-a420-e76639aa4dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:27.136302 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1420/2783] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:27.140759 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4845ab1-001b-4fdd-b8a3-13152b284e8b service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:27.150555 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4845ab1-001b-4fdd-b8a3-13152b284e8b service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:27.155053 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69dd5-e524-4c84-a371-7e9e5ccc9039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:27.155686 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69dd5-e524-4c84-a371-7e9e5ccc9039 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:27.155964 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69dd5-e524-4c84-a371-7e9e5ccc9039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:27.156229 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f69dd5-e524-4c84-a371-7e9e5ccc9039 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:27.156902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f69dd5-e524-4c84-a371-7e9e5ccc9039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:27.159081 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f69dd5-e524-4c84-a371-7e9e5ccc9039 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:27.240250 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1364/2784] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:09:27 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:09:27.244299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52673aa1-2956-4425-a420-e76639aa4dae None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:27.255060 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52673aa1-2956-4425-a420-e76639aa4dae None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:27.310821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28686d66-94ad-4ec3-9db0-d981b3c398fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:27.310821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686d66-94ad-4ec3-9db0-d981b3c398fc admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:27.310821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686d66-94ad-4ec3-9db0-d981b3c398fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:27.310821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686d66-94ad-4ec3-9db0-d981b3c398fc admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:27.311308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28686d66-94ad-4ec3-9db0-d981b3c398fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:27.312173 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28686d66-94ad-4ec3-9db0-d981b3c398fc admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:27.418202 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1421/2785] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:09:27 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:09:27.422264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69dd5-e524-4c84-a371-7e9e5ccc9039 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:27.433309 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f69dd5-e524-4c84-a371-7e9e5ccc9039 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:27.437825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a506c-6a9f-4116-baf9-4d6e4604d62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:27.438537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a506c-6a9f-4116-baf9-4d6e4604d62d admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:27.442751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a506c-6a9f-4116-baf9-4d6e4604d62d admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:27.442751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a506c-6a9f-4116-baf9-4d6e4604d62d admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:27.442751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a506c-6a9f-4116-baf9-4d6e4604d62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:27.442751 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a506c-6a9f-4116-baf9-4d6e4604d62d admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:27.451713 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1365/2786] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:27.455915 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28686d66-94ad-4ec3-9db0-d981b3c398fc admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:27.465780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28686d66-94ad-4ec3-9db0-d981b3c398fc admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:27.471087 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746fbc5-eed2-40b6-99fd-b5f35f6e3889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:27.471999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fbc5-eed2-40b6-99fd-b5f35f6e3889 admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:27.472300 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fbc5-eed2-40b6-99fd-b5f35f6e3889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:27.472570 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746fbc5-eed2-40b6-99fd-b5f35f6e3889 admin admin] PATH_INFO: `/v3/projects/5a3e0019d6b14850ad98432ce9170087/users/e290340468384d2a853c21cde9ed000d/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:27.487436 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746fbc5-eed2-40b6-99fd-b5f35f6e3889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3e0019d6b14850ad98432ce9170087, user_id=e290340468384d2a853c21cde9ed000d, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:27.490140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746fbc5-eed2-40b6-99fd-b5f35f6e3889 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:27.570547 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1422/2787] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:09:27 2022] PUT /identity/v3/projects/5a3e0019d6b14850ad98432ce9170087/users/e290340468384d2a853c21cde9ed000d/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:27.574441 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a506c-6a9f-4116-baf9-4d6e4604d62d admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:27.584870 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a506c-6a9f-4116-baf9-4d6e4604d62d admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:27.640076 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d41ec-fc38-46b4-87f7-8f4ad85080d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:27.640732 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d41ec-fc38-46b4-87f7-8f4ad85080d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:27.641007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d41ec-fc38-46b4-87f7-8f4ad85080d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:27.641277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d41ec-fc38-46b4-87f7-8f4ad85080d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:27.642643 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d41ec-fc38-46b4-87f7-8f4ad85080d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:27.644224 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d41ec-fc38-46b4-87f7-8f4ad85080d5 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:27.653691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1366/2788] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:27.658587 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746fbc5-eed2-40b6-99fd-b5f35f6e3889 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:27.668489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746fbc5-eed2-40b6-99fd-b5f35f6e3889 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:27.673135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8e484-3e9e-4735-941d-e7e53728ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:27.674126 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8e484-3e9e-4735-941d-e7e53728ecbc admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:27.677772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8e484-3e9e-4735-941d-e7e53728ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:27.677772 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8e484-3e9e-4735-941d-e7e53728ecbc admin admin] PATH_INFO: `/v3/projects/5a3e0019d6b14850ad98432ce9170087/users/e290340468384d2a853c21cde9ed000d/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:27.678058 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8e484-3e9e-4735-941d-e7e53728ecbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3e0019d6b14850ad98432ce9170087, user_id=e290340468384d2a853c21cde9ed000d, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:27.681398 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8e484-3e9e-4735-941d-e7e53728ecbc admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:27.697590 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1423/2789] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:09:27 2022] PUT /identity/v3/projects/5a3e0019d6b14850ad98432ce9170087/users/e290340468384d2a853c21cde9ed000d/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:28.921554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2183f7c-fc46-4f41-80b8-d9c21f81231c None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:28.921972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2183f7c-fc46-4f41-80b8-d9c21f81231c None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:28.922131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2183f7c-fc46-4f41-80b8-d9c21f81231c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:28.949948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-f2183f7c-fc46-4f41-80b8-d9c21f81231c None None] MFA Rules not processed for user `e290340468384d2a853c21cde9ed000d`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:28.951292 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f2183f7c-fc46-4f41-80b8-d9c21f81231c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:29.020036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1367/2790] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:28 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:29.030932 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8e484-3e9e-4735-941d-e7e53728ecbc admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:29.032671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-80f8e484-3e9e-4735-941d-e7e53728ecbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:29.093097 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8e484-3e9e-4735-941d-e7e53728ecbc admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:29.096676 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bda0fb-a733-49d5-89fb-018c36cc91a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:29.097307 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bda0fb-a733-49d5-89fb-018c36cc91a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:29.097588 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bda0fb-a733-49d5-89fb-018c36cc91a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:29.097862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bda0fb-a733-49d5-89fb-018c36cc91a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:29.153090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bda0fb-a733-49d5-89fb-018c36cc91a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:29.154468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bda0fb-a733-49d5-89fb-018c36cc91a7 service cinder] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:29.163248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1424/2791] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:09:30.875889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2183f7c-fc46-4f41-80b8-d9c21f81231c None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:30.881761 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f2183f7c-fc46-4f41-80b8-d9c21f81231c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:30.889107 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2183f7c-fc46-4f41-80b8-d9c21f81231c None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:30.893201 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601fc09-56dc-42ef-92fc-f674750e0c2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:30.893834 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601fc09-56dc-42ef-92fc-f674750e0c2a service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:30.894151 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601fc09-56dc-42ef-92fc-f674750e0c2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:30.894422 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601fc09-56dc-42ef-92fc-f674750e0c2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:30.903391 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601fc09-56dc-42ef-92fc-f674750e0c2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:30.904854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601fc09-56dc-42ef-92fc-f674750e0c2a service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:30.914940 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1368/2792] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:09:46.427192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bda0fb-a733-49d5-89fb-018c36cc91a7 service cinder] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:46.489175 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bda0fb-a733-49d5-89fb-018c36cc91a7 service cinder] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:46.493917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:46.494799 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:46.495075 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:46.495343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] PATH_INFO: `/v3/users/1f52907a100848748926f974781599b7` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:46.496521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f52907a100848748926f974781599b7)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:46.498467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:46.679489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f52907a100848748926f974781599b7'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:46.686106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f52907a100848748926f974781599b7'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:46.760680 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f52907a100848748926f974781599b7'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:46.773517 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f52907a100848748926f974781599b7'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:46.776240 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f52907a100848748926f974781599b7'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:46.779903 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1425/2793] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:09:46 2022] DELETE /identity/v3/users/1f52907a100848748926f974781599b7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:47.025287 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601fc09-56dc-42ef-92fc-f674750e0c2a service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:47.035815 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601fc09-56dc-42ef-92fc-f674750e0c2a service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:47.090521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:47.091375 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:47.091656 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:47.091931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] PATH_INFO: `/v3/projects/8870157c806544a9a3a1f11176fcaa52` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:47.093105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8870157c806544a9a3a1f11176fcaa52)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:47.095036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:47.196131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8870157c806544a9a3a1f11176fcaa52', 'request_id': 'req-6e269544-0497-46ec-b063-781f5014b9b5'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:47.202211 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8870157c806544a9a3a1f11176fcaa52', 'request_id': 'req-6e269544-0497-46ec-b063-781f5014b9b5'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:47.207542 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8870157c806544a9a3a1f11176fcaa52', 'request_id': 'req-6e269544-0497-46ec-b063-781f5014b9b5'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:47.291351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] The token cache is being invalidate because project 8870157c806544a9a3a1f11176fcaa52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:09:47.291554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:47.292486 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:47.294265 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1369/2794] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:09:47 2022] DELETE /identity/v3/projects/8870157c806544a9a3a1f11176fcaa52 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:47.298380 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:47.299987 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:47.313618 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d9bb4-9bc1-49f0-9011-a4fe2a763e6c admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:47.369780 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:47.370701 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:47.370976 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:47.371243 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] PATH_INFO: `/v3/users/e290340468384d2a853c21cde9ed000d` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:47.372420 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e290340468384d2a853c21cde9ed000d)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:47.374334 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:47.617658 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e290340468384d2a853c21cde9ed000d'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:47.624322 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e290340468384d2a853c21cde9ed000d'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:47.701034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e290340468384d2a853c21cde9ed000d'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:47.715375 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e290340468384d2a853c21cde9ed000d'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:47.716040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-7a3b9074-6f26-448f-8269-afd8c121f164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e290340468384d2a853c21cde9ed000d'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:47.721895 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1426/2795] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:09:47 2022] DELETE /identity/v3/users/e290340468384d2a853c21cde9ed000d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:48.247835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:48.249829 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:48.270245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e269544-0497-46ec-b063-781f5014b9b5 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:48.337802 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:48.338701 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:48.338987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:48.339267 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] PATH_INFO: `/v3/projects/5a3e0019d6b14850ad98432ce9170087` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:48.340481 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3e0019d6b14850ad98432ce9170087)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:48.342428 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:48.452950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3e0019d6b14850ad98432ce9170087', 'request_id': 'req-6e36c27f-ca24-4433-9fe5-724274a8ab29'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:48.459129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3e0019d6b14850ad98432ce9170087', 'request_id': 'req-6e36c27f-ca24-4433-9fe5-724274a8ab29'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:48.464959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3e0019d6b14850ad98432ce9170087', 'request_id': 'req-6e36c27f-ca24-4433-9fe5-724274a8ab29'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:48.554783 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] The token cache is being invalidate because project 5a3e0019d6b14850ad98432ce9170087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:09:48.555073 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:48.555692 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-6e36c27f-ca24-4433-9fe5-724274a8ab29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:48.557299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1370/2796] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:09:48 2022] DELETE /identity/v3/projects/5a3e0019d6b14850ad98432ce9170087 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:48.562260 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d28a-5b70-4658-821c-e960931592bd None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:48.562746 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d28a-5b70-4658-821c-e960931592bd None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:48.563022 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01d28a-5b70-4658-821c-e960931592bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:48.581379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ff01d28a-5b70-4658-821c-e960931592bd None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:48.582596 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ff01d28a-5b70-4658-821c-e960931592bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:48.640471 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1427/2797] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:48.648787 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baab556-e016-4497-a7ed-660154825ba6 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:48.649079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baab556-e016-4497-a7ed-660154825ba6 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:48.649361 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baab556-e016-4497-a7ed-660154825ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:48.667611 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-3baab556-e016-4497-a7ed-660154825ba6 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:48.668830 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3baab556-e016-4497-a7ed-660154825ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:48.676907 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1371/2798] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:09:48.681919 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01d28a-5b70-4658-821c-e960931592bd None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:48.691523 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01d28a-5b70-4658-821c-e960931592bd None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:48.697418 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997bad8-a757-4335-b1c0-7f9c8b4a6ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:48.698122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997bad8-a757-4335-b1c0-7f9c8b4a6ecf admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:48.698410 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997bad8-a757-4335-b1c0-7f9c8b4a6ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:48.698718 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997bad8-a757-4335-b1c0-7f9c8b4a6ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:48.699614 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997bad8-a757-4335-b1c0-7f9c8b4a6ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:09:48.699970 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997bad8-a757-4335-b1c0-7f9c8b4a6ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:48.701682 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997bad8-a757-4335-b1c0-7f9c8b4a6ecf admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:48.718016 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1428/2799] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:09:48.719228 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baab556-e016-4497-a7ed-660154825ba6 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:48.729326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baab556-e016-4497-a7ed-660154825ba6 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:48.734110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04785b7-e4fc-4fd1-af32-52f8aec8f419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:48.737801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04785b7-e4fc-4fd1-af32-52f8aec8f419 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:48.737801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04785b7-e4fc-4fd1-af32-52f8aec8f419 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:48.737801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04785b7-e4fc-4fd1-af32-52f8aec8f419 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:48.737801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04785b7-e4fc-4fd1-af32-52f8aec8f419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:48.737801 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04785b7-e4fc-4fd1-af32-52f8aec8f419 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:48.836490 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1372/2800] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:09:48 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:09:48.838402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997bad8-a757-4335-b1c0-7f9c8b4a6ecf admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:48.848742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997bad8-a757-4335-b1c0-7f9c8b4a6ecf admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:48.915543 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977ed81-9234-43ce-8fb9-8c6755e90d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:48.916238 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ed81-9234-43ce-8fb9-8c6755e90d34 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:48.916518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ed81-9234-43ce-8fb9-8c6755e90d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:48.916786 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ed81-9234-43ce-8fb9-8c6755e90d34 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:48.917473 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977ed81-9234-43ce-8fb9-8c6755e90d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:48.919814 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977ed81-9234-43ce-8fb9-8c6755e90d34 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:49.033264 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1429/2801] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:09:48 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:09:49.037400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04785b7-e4fc-4fd1-af32-52f8aec8f419 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:49.048063 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04785b7-e4fc-4fd1-af32-52f8aec8f419 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:49.060399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb7cd4-00ab-4af6-bf0e-b47f43a6b594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:49.060399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb7cd4-00ab-4af6-bf0e-b47f43a6b594 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:49.060399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb7cd4-00ab-4af6-bf0e-b47f43a6b594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:49.060399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb7cd4-00ab-4af6-bf0e-b47f43a6b594 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:49.060877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb7cd4-00ab-4af6-bf0e-b47f43a6b594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:49.060877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb7cd4-00ab-4af6-bf0e-b47f43a6b594 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:49.069515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1373/2802] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:49.073781 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977ed81-9234-43ce-8fb9-8c6755e90d34 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:49.083801 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977ed81-9234-43ce-8fb9-8c6755e90d34 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:49.089666 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ff816-63dd-4874-9fd3-7d6564f86b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:49.090242 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ff816-63dd-4874-9fd3-7d6564f86b7b admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:49.090667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ff816-63dd-4874-9fd3-7d6564f86b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:49.090953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ff816-63dd-4874-9fd3-7d6564f86b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:49.091692 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ff816-63dd-4874-9fd3-7d6564f86b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:49.093291 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ff816-63dd-4874-9fd3-7d6564f86b7b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:49.104088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1430/2803] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:49.108264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb7cd4-00ab-4af6-bf0e-b47f43a6b594 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:49.118470 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb7cd4-00ab-4af6-bf0e-b47f43a6b594 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:49.124657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f270d-c618-47b9-bf40-54c309c39c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:49.124657 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f270d-c618-47b9-bf40-54c309c39c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:49.124909 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f270d-c618-47b9-bf40-54c309c39c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:49.125237 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f270d-c618-47b9-bf40-54c309c39c98 admin admin] PATH_INFO: `/v3/projects/9dfc68759f1a482b81562dec165553b1/users/4eadb498bb7f4b65b50176b590b40242/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:49.141740 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f270d-c618-47b9-bf40-54c309c39c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfc68759f1a482b81562dec165553b1, user_id=4eadb498bb7f4b65b50176b590b40242, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:49.144463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f270d-c618-47b9-bf40-54c309c39c98 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:49.202474 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1374/2804] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:09:49 2022] PUT /identity/v3/projects/9dfc68759f1a482b81562dec165553b1/users/4eadb498bb7f4b65b50176b590b40242/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:49.214485 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6d90c-2ce7-46a2-9dd9-bd04e0e2bf5d None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:49.214769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6d90c-2ce7-46a2-9dd9-bd04e0e2bf5d None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:49.215044 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6d90c-2ce7-46a2-9dd9-bd04e0e2bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:49.245471 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-20e6d90c-2ce7-46a2-9dd9-bd04e0e2bf5d None None] MFA Rules not processed for user `4eadb498bb7f4b65b50176b590b40242`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:49.246716 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-20e6d90c-2ce7-46a2-9dd9-bd04e0e2bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:49.341635 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1431/2805] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:49.355240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f270d-c618-47b9-bf40-54c309c39c98 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:49.357717 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dd4f270d-c618-47b9-bf40-54c309c39c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:49.421300 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f270d-c618-47b9-bf40-54c309c39c98 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:49.425135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ef8c7-2d19-4956-a3aa-e6b28c0dc6c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:49.425792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef8c7-2d19-4956-a3aa-e6b28c0dc6c2 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:49.426521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef8c7-2d19-4956-a3aa-e6b28c0dc6c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:49.426521 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ef8c7-2d19-4956-a3aa-e6b28c0dc6c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:49.436893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ef8c7-2d19-4956-a3aa-e6b28c0dc6c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:49.438785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ef8c7-2d19-4956-a3aa-e6b28c0dc6c2 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:49.449205 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1375/2806] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:09:49.475444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6d90c-2ce7-46a2-9dd9-bd04e0e2bf5d None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:49.550120 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6d90c-2ce7-46a2-9dd9-bd04e0e2bf5d None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:49.555122 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:49.555992 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:49.556271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:49.556563 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] PATH_INFO: `/v3/users/4eadb498bb7f4b65b50176b590b40242` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:49.557769 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eadb498bb7f4b65b50176b590b40242)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:49.559727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:49.745062 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eadb498bb7f4b65b50176b590b40242'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:49.752373 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eadb498bb7f4b65b50176b590b40242'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:49.812308 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eadb498bb7f4b65b50176b590b40242'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:49.825820 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eadb498bb7f4b65b50176b590b40242'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:49.826566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eadb498bb7f4b65b50176b590b40242'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:49.832341 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1432/2807] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:09:49 2022] DELETE /identity/v3/users/4eadb498bb7f4b65b50176b590b40242 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:49.837635 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da22d0c-12aa-4a34-8116-4694220eba4b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:49.837920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da22d0c-12aa-4a34-8116-4694220eba4b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:49.838230 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da22d0c-12aa-4a34-8116-4694220eba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:49.855920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8da22d0c-12aa-4a34-8116-4694220eba4b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:49.857196 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8da22d0c-12aa-4a34-8116-4694220eba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:49.918272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1376/2808] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:49.928197 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:49.929842 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:49.997214 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c72dc3-f3b7-4bfe-8c35-2524ccb6cc00 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:50.000955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694fb7b-4638-4dcf-9d61-a7fd88d6fcbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:50.001597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694fb7b-4638-4dcf-9d61-a7fd88d6fcbe service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:50.001879 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694fb7b-4638-4dcf-9d61-a7fd88d6fcbe service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:50.002182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694fb7b-4638-4dcf-9d61-a7fd88d6fcbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:50.014356 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694fb7b-4638-4dcf-9d61-a7fd88d6fcbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:50.015706 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694fb7b-4638-4dcf-9d61-a7fd88d6fcbe service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:50.026092 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1433/2809] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:09:50.497372 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da22d0c-12aa-4a34-8116-4694220eba4b None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:50.499439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8da22d0c-12aa-4a34-8116-4694220eba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:50.517103 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da22d0c-12aa-4a34-8116-4694220eba4b None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:50.529477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:50.530421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:50.531395 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:50.531705 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] PATH_INFO: `/v3/projects/9dfc68759f1a482b81562dec165553b1` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:50.532903 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dfc68759f1a482b81562dec165553b1)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:50.535036 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:50.657564 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dfc68759f1a482b81562dec165553b1', 'request_id': 'req-73a99696-b1f9-4897-b876-58be2b1a5f55'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:50.664532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dfc68759f1a482b81562dec165553b1', 'request_id': 'req-73a99696-b1f9-4897-b876-58be2b1a5f55'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:50.669890 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dfc68759f1a482b81562dec165553b1', 'request_id': 'req-73a99696-b1f9-4897-b876-58be2b1a5f55'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:50.783988 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] The token cache is being invalidate because project 9dfc68759f1a482b81562dec165553b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:09:50.784277 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:50.789136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-73a99696-b1f9-4897-b876-58be2b1a5f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:09:50.789136 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1377/2810] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:09:50 2022] DELETE /identity/v3/projects/9dfc68759f1a482b81562dec165553b1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:50.792744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86e7a2-9592-4cfc-8b66-c23fabd9242c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:50.793232 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86e7a2-9592-4cfc-8b66-c23fabd9242c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:50.793340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86e7a2-9592-4cfc-8b66-c23fabd9242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:50.810671 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0a86e7a2-9592-4cfc-8b66-c23fabd9242c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:50.811797 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0a86e7a2-9592-4cfc-8b66-c23fabd9242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:50.870447 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1434/2811] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:50.929984 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a274ce-e687-469b-a56a-f3602ea8cbb4 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:50.930388 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a274ce-e687-469b-a56a-f3602ea8cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:50.930663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a274ce-e687-469b-a56a-f3602ea8cbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:50.950904 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-d3a274ce-e687-469b-a56a-f3602ea8cbb4 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:50.955485 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-d3a274ce-e687-469b-a56a-f3602ea8cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:50.961562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1378/2812] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:50.965880 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86e7a2-9592-4cfc-8b66-c23fabd9242c None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:50.976744 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86e7a2-9592-4cfc-8b66-c23fabd9242c None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:50.984170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ebe98-6170-4e11-bf3e-511436e934ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:50.984170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ebe98-6170-4e11-bf3e-511436e934ab admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:50.984170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ebe98-6170-4e11-bf3e-511436e934ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:50.984170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ebe98-6170-4e11-bf3e-511436e934ab admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:50.984582 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ebe98-6170-4e11-bf3e-511436e934ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:09:50.984582 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ebe98-6170-4e11-bf3e-511436e934ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:50.985487 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ebe98-6170-4e11-bf3e-511436e934ab admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:51.001139 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1435/2813] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:09:51.002325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a274ce-e687-469b-a56a-f3602ea8cbb4 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:51.016722 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a274ce-e687-469b-a56a-f3602ea8cbb4 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:51.017004 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260920-0bc7-4d31-90f3-0af5e4818435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:51.017679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260920-0bc7-4d31-90f3-0af5e4818435 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:51.017956 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260920-0bc7-4d31-90f3-0af5e4818435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:51.018276 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09260920-0bc7-4d31-90f3-0af5e4818435 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:51.018977 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09260920-0bc7-4d31-90f3-0af5e4818435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:51.020889 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09260920-0bc7-4d31-90f3-0af5e4818435 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:51.111052 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1379/2814] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:09:51 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:09:51.115714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ebe98-6170-4e11-bf3e-511436e934ab admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:51.125630 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ebe98-6170-4e11-bf3e-511436e934ab admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:51.181886 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe189c-5755-4717-ae38-d988956ac9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:51.182617 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe189c-5755-4717-ae38-d988956ac9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:51.182897 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe189c-5755-4717-ae38-d988956ac9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:51.183170 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe189c-5755-4717-ae38-d988956ac9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:51.183851 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe189c-5755-4717-ae38-d988956ac9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:51.185731 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe189c-5755-4717-ae38-d988956ac9a6 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:51.240109 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1436/2815] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:09:51 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:09:51.244689 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260920-0bc7-4d31-90f3-0af5e4818435 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:51.254820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09260920-0bc7-4d31-90f3-0af5e4818435 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:51.260102 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ec2ba-225d-436a-966f-de55db99f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:51.260687 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ec2ba-225d-436a-966f-de55db99f1df admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:51.260965 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ec2ba-225d-436a-966f-de55db99f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:51.261234 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ec2ba-225d-436a-966f-de55db99f1df admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:51.261952 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ec2ba-225d-436a-966f-de55db99f1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:51.263606 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ec2ba-225d-436a-966f-de55db99f1df admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:51.274790 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1380/2816] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:51.278606 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe189c-5755-4717-ae38-d988956ac9a6 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:51.288999 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe189c-5755-4717-ae38-d988956ac9a6 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:51.293791 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a318d-a2c6-4067-bcb9-998c147ba73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:51.294501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a318d-a2c6-4067-bcb9-998c147ba73a admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:51.294778 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a318d-a2c6-4067-bcb9-998c147ba73a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:51.295053 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a318d-a2c6-4067-bcb9-998c147ba73a admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:51.295774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a318d-a2c6-4067-bcb9-998c147ba73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:51.297340 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a318d-a2c6-4067-bcb9-998c147ba73a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:51.307736 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1437/2817] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:09:51.312398 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ec2ba-225d-436a-966f-de55db99f1df admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:51.323171 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ec2ba-225d-436a-966f-de55db99f1df admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:51.327758 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c567ec-1aec-406b-89ff-8cc927864f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:51.328616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c567ec-1aec-406b-89ff-8cc927864f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:51.328888 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c567ec-1aec-406b-89ff-8cc927864f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:51.329319 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c567ec-1aec-406b-89ff-8cc927864f45 admin admin] PATH_INFO: `/v3/projects/30c10ed3e82644e1b58434748f9472cd/users/720debbbc4a74949b7b2f42069e5f2f6/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:51.344351 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c567ec-1aec-406b-89ff-8cc927864f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c10ed3e82644e1b58434748f9472cd, user_id=720debbbc4a74949b7b2f42069e5f2f6, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:51.347146 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c567ec-1aec-406b-89ff-8cc927864f45 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:51.570454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1381/2818] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:09:51 2022] PUT /identity/v3/projects/30c10ed3e82644e1b58434748f9472cd/users/720debbbc4a74949b7b2f42069e5f2f6/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:09:51.580647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c0d66-5ca3-4d6e-bf0d-8c1e1df5c374 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:51.580934 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c0d66-5ca3-4d6e-bf0d-8c1e1df5c374 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:51.581211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c0d66-5ca3-4d6e-bf0d-8c1e1df5c374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:51.608290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-d19c0d66-5ca3-4d6e-bf0d-8c1e1df5c374 None None] MFA Rules not processed for user `720debbbc4a74949b7b2f42069e5f2f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:51.609483 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d19c0d66-5ca3-4d6e-bf0d-8c1e1df5c374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:51.675626 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1438/2819] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:51.687243 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c567ec-1aec-406b-89ff-8cc927864f45 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:51.688994 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-b5c567ec-1aec-406b-89ff-8cc927864f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:51.753105 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c567ec-1aec-406b-89ff-8cc927864f45 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:51.757552 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf70be-9a74-46c3-b2c9-c1dfe8c0e538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:51.758223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf70be-9a74-46c3-b2c9-c1dfe8c0e538 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:51.758504 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf70be-9a74-46c3-b2c9-c1dfe8c0e538 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:51.758777 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf70be-9a74-46c3-b2c9-c1dfe8c0e538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:51.767111 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf70be-9a74-46c3-b2c9-c1dfe8c0e538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:51.768532 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf70be-9a74-46c3-b2c9-c1dfe8c0e538 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:51.777272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1382/2820] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:09:53.494178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e02d-9eba-4e11-8cbe-4097a5e4b7de None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:53.494731 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e02d-9eba-4e11-8cbe-4097a5e4b7de None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:53.494731 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77e02d-9eba-4e11-8cbe-4097a5e4b7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:53.512184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4c77e02d-9eba-4e11-8cbe-4097a5e4b7de None None] MFA Rules not processed for user `720debbbc4a74949b7b2f42069e5f2f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:09:53.513443 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4c77e02d-9eba-4e11-8cbe-4097a5e4b7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:53.520444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1439/2821] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:09:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:09:54.983965 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf70be-9a74-46c3-b2c9-c1dfe8c0e538 service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:09:54.985429 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-31bf70be-9a74-46c3-b2c9-c1dfe8c0e538 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:55.042943 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf70be-9a74-46c3-b2c9-c1dfe8c0e538 service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:09:55.046529 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd6a5d-2ac5-4930-9659-f0f41fc582bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:09:55.047408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd6a5d-2ac5-4930-9659-f0f41fc582bb service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:09:55.049500 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd6a5d-2ac5-4930-9659-f0f41fc582bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:09:55.049795 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd6a5d-2ac5-4930-9659-f0f41fc582bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:09:55.053213 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-83fd6a5d-2ac5-4930-9659-f0f41fc582bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:09:55.119807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd6a5d-2ac5-4930-9659-f0f41fc582bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:09:55.121244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd6a5d-2ac5-4930-9659-f0f41fc582bb service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:09:55.132191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1383/2822] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 22:10:03.787985 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77e02d-9eba-4e11-8cbe-4097a5e4b7de None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:03.790205 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4c77e02d-9eba-4e11-8cbe-4097a5e4b7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:03.805427 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77e02d-9eba-4e11-8cbe-4097a5e4b7de None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:03.810154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:03.811020 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:03.811299 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:03.811566 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] PATH_INFO: `/v3/users/02109279bdf1443d89eb8c219a967ba8` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:03.812742 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] RBAC: Authorizing `identity:delete_user(user_id=02109279bdf1443d89eb8c219a967ba8)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:03.814700 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:03.979469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02109279bdf1443d89eb8c219a967ba8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:03.986698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02109279bdf1443d89eb8c219a967ba8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.054611 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02109279bdf1443d89eb8c219a967ba8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.067632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02109279bdf1443d89eb8c219a967ba8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.068277 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02109279bdf1443d89eb8c219a967ba8'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.074176 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1440/2823] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:10:03 2022] DELETE /identity/v3/users/02109279bdf1443d89eb8c219a967ba8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:10:04.319130 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd6a5d-2ac5-4930-9659-f0f41fc582bb service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:04.329612 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd6a5d-2ac5-4930-9659-f0f41fc582bb service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:04.391776 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:04.392566 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:04.392895 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:04.393174 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] PATH_INFO: `/v3/projects/bc0c18f4d6ce4a21ba84b7f544ea90b7` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:04.394450 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0c18f4d6ce4a21ba84b7f544ea90b7)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:04.396354 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:04.496838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0c18f4d6ce4a21ba84b7f544ea90b7', 'request_id': 'req-8c716767-1d43-40c3-a8fa-a04265e6e9bd'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.502989 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0c18f4d6ce4a21ba84b7f544ea90b7', 'request_id': 'req-8c716767-1d43-40c3-a8fa-a04265e6e9bd'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.509165 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0c18f4d6ce4a21ba84b7f544ea90b7', 'request_id': 'req-8c716767-1d43-40c3-a8fa-a04265e6e9bd'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.599515 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] The token cache is being invalidate because project bc0c18f4d6ce4a21ba84b7f544ea90b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:10:04.599838 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.600503 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.602074 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1384/2824] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:10:04 2022] DELETE /identity/v3/projects/bc0c18f4d6ce4a21ba84b7f544ea90b7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:10:04.605890 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:04.607364 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:04.620154 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c741-bbf5-4553-8647-1a3e7184792f admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:04.673575 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:04.674403 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:04.674686 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:04.674962 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] PATH_INFO: `/v3/users/e78f56793db846168b4d176398b74eae` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:04.676131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78f56793db846168b4d176398b74eae)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:04.678078 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:04.888656 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78f56793db846168b4d176398b74eae'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.895641 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78f56793db846168b4d176398b74eae'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.980399 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78f56793db846168b4d176398b74eae'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.992827 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78f56793db846168b4d176398b74eae'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.993457 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-4b724a78-3468-4297-bb53-7a0483abd109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78f56793db846168b4d176398b74eae'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:04.999230 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1441/2825] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:10:04 2022] DELETE /identity/v3/users/e78f56793db846168b4d176398b74eae => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:10:05.227129 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:05.228735 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:05.241455 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c716767-1d43-40c3-a8fa-a04265e6e9bd admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:05.297075 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:05.297931 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:05.298240 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:05.298511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] PATH_INFO: `/v3/projects/6223deacc76b48fd868eb50df1dd3c75` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:05.299706 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6223deacc76b48fd868eb50df1dd3c75)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:05.301623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:05.407426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6223deacc76b48fd868eb50df1dd3c75', 'request_id': 'req-095db2e2-6df3-4f54-b25a-33cb082e77d1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:05.413274 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6223deacc76b48fd868eb50df1dd3c75', 'request_id': 'req-095db2e2-6df3-4f54-b25a-33cb082e77d1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:05.419246 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6223deacc76b48fd868eb50df1dd3c75', 'request_id': 'req-095db2e2-6df3-4f54-b25a-33cb082e77d1'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:05.513715 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] The token cache is being invalidate because project 6223deacc76b48fd868eb50df1dd3c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:10:05.513937 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:05.514589 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:05.516131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1385/2826] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:10:05 2022] DELETE /identity/v3/projects/6223deacc76b48fd868eb50df1dd3c75 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:10:12.649370 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983139d-ed8b-4941-8d4d-47a3020ad081 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:12.650687 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983139d-ed8b-4941-8d4d-47a3020ad081 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:12.651098 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983139d-ed8b-4941-8d4d-47a3020ad081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:12.717711 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-4983139d-ed8b-4941-8d4d-47a3020ad081 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:10:12.718942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-4983139d-ed8b-4941-8d4d-47a3020ad081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:12.793900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1442/2827] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:10:12.954837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:12.956294 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:13.056257 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095db2e2-6df3-4f54-b25a-33cb082e77d1 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:13.061239 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d88b6c-cf25-4ac3-9145-54b9f33006fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:13.061883 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d88b6c-cf25-4ac3-9145-54b9f33006fc service swift] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:13.062199 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d88b6c-cf25-4ac3-9145-54b9f33006fc service swift] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:13.062476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d88b6c-cf25-4ac3-9145-54b9f33006fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:13.072227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d88b6c-cf25-4ac3-9145-54b9f33006fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:13.073799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d88b6c-cf25-4ac3-9145-54b9f33006fc service swift] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:13.081609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1386/2828] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:10:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:10:13.943314 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76044957-d4a6-4ac7-8cdf-5c7b27e13ae7 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:13.943756 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76044957-d4a6-4ac7-8cdf-5c7b27e13ae7 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:13.943869 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76044957-d4a6-4ac7-8cdf-5c7b27e13ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:13.962863 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-76044957-d4a6-4ac7-8cdf-5c7b27e13ae7 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:10:13.964034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-76044957-d4a6-4ac7-8cdf-5c7b27e13ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:13.971184 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1443/2829] 10.222.0.26 () {58 vars in 967 bytes} [Mon Feb 28 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:10:13.983623 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d88b6c-cf25-4ac3-9145-54b9f33006fc service swift] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:13.994997 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d88b6c-cf25-4ac3-9145-54b9f33006fc service swift] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:14.000066 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8a7e3-2b5c-4db5-a052-17ce6ff2c619 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:14.000712 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a7e3-2b5c-4db5-a052-17ce6ff2c619 service swift] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:14.000993 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a7e3-2b5c-4db5-a052-17ce6ff2c619 service swift] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:14.001272 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a7e3-2b5c-4db5-a052-17ce6ff2c619 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:14.009370 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8a7e3-2b5c-4db5-a052-17ce6ff2c619 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:14.010967 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8a7e3-2b5c-4db5-a052-17ce6ff2c619 service swift] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:14.018793 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1387/2830] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:10:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:10:14.983733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4da14-f0f9-4aa9-8ef1-d20bb14f0d21 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:14.984237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4da14-f0f9-4aa9-8ef1-d20bb14f0d21 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:14.984337 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4da14-f0f9-4aa9-8ef1-d20bb14f0d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:15.002521 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-74f4da14-f0f9-4aa9-8ef1-d20bb14f0d21 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:10:15.003702 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-74f4da14-f0f9-4aa9-8ef1-d20bb14f0d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:15.011650 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1444/2831] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 22:10:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:10:15.023435 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8a7e3-2b5c-4db5-a052-17ce6ff2c619 service swift] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:15.033928 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8a7e3-2b5c-4db5-a052-17ce6ff2c619 service swift] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:15.038920 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81cec8-cf8e-4a03-99c5-6a61454b04f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:15.039546 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81cec8-cf8e-4a03-99c5-6a61454b04f8 service swift] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:15.039825 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81cec8-cf8e-4a03-99c5-6a61454b04f8 service swift] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:15.040123 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81cec8-cf8e-4a03-99c5-6a61454b04f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:15.047950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81cec8-cf8e-4a03-99c5-6a61454b04f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:15.049541 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81cec8-cf8e-4a03-99c5-6a61454b04f8 service swift] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:15.057884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1388/2832] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:10:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 28 22:10:15.611698 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dc31a-5a56-475e-b04b-e7390d5caa09 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:15.612007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dc31a-5a56-475e-b04b-e7390d5caa09 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:15.612303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dc31a-5a56-475e-b04b-e7390d5caa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:15.630479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-0a0dc31a-5a56-475e-b04b-e7390d5caa09 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:10:15.631655 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0a0dc31a-5a56-475e-b04b-e7390d5caa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:15.638917 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1445/2833] 10.222.0.26 () {58 vars in 967 bytes} [Mon Feb 28 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:10:15.650913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81cec8-cf8e-4a03-99c5-6a61454b04f8 service swift] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:15.661140 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81cec8-cf8e-4a03-99c5-6a61454b04f8 service swift] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:15.666891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82563191-2cac-4787-b8c8-9185cfe531e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:15.667527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82563191-2cac-4787-b8c8-9185cfe531e7 service swift] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:15.667794 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82563191-2cac-4787-b8c8-9185cfe531e7 service swift] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:15.668062 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82563191-2cac-4787-b8c8-9185cfe531e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:15.675972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82563191-2cac-4787-b8c8-9185cfe531e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:15.677524 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82563191-2cac-4787-b8c8-9185cfe531e7 service swift] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:15.685891 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1389/2834] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:10:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:10:18.330089 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dc31a-5a56-475e-b04b-e7390d5caa09 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:18.331530 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-0a0dc31a-5a56-475e-b04b-e7390d5caa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:18.394585 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dc31a-5a56-475e-b04b-e7390d5caa09 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:18.399084 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:18.399958 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:18.400228 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:18.400493 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] PATH_INFO: `/v3/users/720debbbc4a74949b7b2f42069e5f2f6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:18.401677 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=720debbbc4a74949b7b2f42069e5f2f6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:18.403595 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:18.619860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '720debbbc4a74949b7b2f42069e5f2f6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:18.626489 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '720debbbc4a74949b7b2f42069e5f2f6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:18.687695 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '720debbbc4a74949b7b2f42069e5f2f6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:18.700103 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '720debbbc4a74949b7b2f42069e5f2f6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:18.700761 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '720debbbc4a74949b7b2f42069e5f2f6'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:18.706605 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1446/2835] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:10:18 2022] DELETE /identity/v3/users/720debbbc4a74949b7b2f42069e5f2f6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:10:18.711039 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c0663-01b3-4577-890a-613766d8fe54 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:18.711527 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c0663-01b3-4577-890a-613766d8fe54 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:18.711664 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c0663-01b3-4577-890a-613766d8fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:18.729216 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-dd0c0663-01b3-4577-890a-613766d8fe54 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:10:18.730426 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dd0c0663-01b3-4577-890a-613766d8fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:18.786183 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1390/2836] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:10:18.796090 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:18.801518 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:18.855808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5df9c9-7435-43d0-be8d-1ea634834ec8 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:18.859548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94653ddf-7420-41ee-8f28-d012cfc59dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:18.860196 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94653ddf-7420-41ee-8f28-d012cfc59dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:18.860479 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94653ddf-7420-41ee-8f28-d012cfc59dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:18.860754 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94653ddf-7420-41ee-8f28-d012cfc59dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:18.870752 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94653ddf-7420-41ee-8f28-d012cfc59dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:18.872099 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94653ddf-7420-41ee-8f28-d012cfc59dc0 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:18.881335 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1447/2837] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:10:19.339195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c0663-01b3-4577-890a-613766d8fe54 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:19.347046 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-dd0c0663-01b3-4577-890a-613766d8fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:19.352245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c0663-01b3-4577-890a-613766d8fe54 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:19.356902 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:19.357775 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:19.358079 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:19.358397 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] PATH_INFO: `/v3/projects/30c10ed3e82644e1b58434748f9472cd` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:19.359537 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c10ed3e82644e1b58434748f9472cd)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:19.361446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:19.536973 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c10ed3e82644e1b58434748f9472cd', 'request_id': 'req-a714c547-a936-44ff-9ac0-87e47efc2f62'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:19.543116 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c10ed3e82644e1b58434748f9472cd', 'request_id': 'req-a714c547-a936-44ff-9ac0-87e47efc2f62'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:19.548387 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c10ed3e82644e1b58434748f9472cd', 'request_id': 'req-a714c547-a936-44ff-9ac0-87e47efc2f62'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:19.616087 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] The token cache is being invalidate because project 30c10ed3e82644e1b58434748f9472cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:10:19.616376 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:19.616991 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-a714c547-a936-44ff-9ac0-87e47efc2f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:10:19.619497 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1391/2838] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:10:19 2022] DELETE /identity/v3/projects/30c10ed3e82644e1b58434748f9472cd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:10:19.624352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5f23-eb4f-4633-a1ee-d8cfda5d6a16 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:19.624847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5f23-eb4f-4633-a1ee-d8cfda5d6a16 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:19.624952 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5f23-eb4f-4633-a1ee-d8cfda5d6a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:19.642684 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-667d5f23-eb4f-4633-a1ee-d8cfda5d6a16 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:10:19.643867 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-667d5f23-eb4f-4633-a1ee-d8cfda5d6a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:19.702271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1448/2839] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:10:19.710170 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575eb54-c52f-417a-89fd-926414514233 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:19.710530 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575eb54-c52f-417a-89fd-926414514233 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:19.710877 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575eb54-c52f-417a-89fd-926414514233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:19.729463 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-a575eb54-c52f-417a-89fd-926414514233 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:10:19.730779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-a575eb54-c52f-417a-89fd-926414514233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:19.738693 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1392/2840] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:10:19.743425 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d5f23-eb4f-4633-a1ee-d8cfda5d6a16 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:19.752817 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d5f23-eb4f-4633-a1ee-d8cfda5d6a16 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:19.757379 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb423a68-9cb3-442d-8da9-e0b0e1a56444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:19.758048 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb423a68-9cb3-442d-8da9-e0b0e1a56444 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:19.758327 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb423a68-9cb3-442d-8da9-e0b0e1a56444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:19.759208 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb423a68-9cb3-442d-8da9-e0b0e1a56444 admin admin] PATH_INFO: `/v3/domains` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:19.759925 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb423a68-9cb3-442d-8da9-e0b0e1a56444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:10:19.760225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb423a68-9cb3-442d-8da9-e0b0e1a56444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:19.761796 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb423a68-9cb3-442d-8da9-e0b0e1a56444 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:19.776295 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1449/2841] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:10:19.777547 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575eb54-c52f-417a-89fd-926414514233 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:19.787264 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575eb54-c52f-417a-89fd-926414514233 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:19.792741 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0597f92-11dd-4d29-a1fd-18e0c32f1680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:19.793399 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0597f92-11dd-4d29-a1fd-18e0c32f1680 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:19.793677 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0597f92-11dd-4d29-a1fd-18e0c32f1680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:19.793948 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0597f92-11dd-4d29-a1fd-18e0c32f1680 admin admin] PATH_INFO: `/v3/projects` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:19.794665 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0597f92-11dd-4d29-a1fd-18e0c32f1680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:19.796610 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0597f92-11dd-4d29-a1fd-18e0c32f1680 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:19.881223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1393/2842] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:10:19 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:10:19.886173 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb423a68-9cb3-442d-8da9-e0b0e1a56444 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:19.896087 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb423a68-9cb3-442d-8da9-e0b0e1a56444 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:19.950107 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e01ba-b7d9-4e3e-b69d-918006a0fe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:19.950775 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e01ba-b7d9-4e3e-b69d-918006a0fe1a admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:19.951055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e01ba-b7d9-4e3e-b69d-918006a0fe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:19.951355 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e01ba-b7d9-4e3e-b69d-918006a0fe1a admin admin] PATH_INFO: `/v3/users` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:19.952033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e01ba-b7d9-4e3e-b69d-918006a0fe1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:19.953923 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e01ba-b7d9-4e3e-b69d-918006a0fe1a admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:20.030497 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1450/2843] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:10:19 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:10:20.034778 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0597f92-11dd-4d29-a1fd-18e0c32f1680 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:20.045495 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0597f92-11dd-4d29-a1fd-18e0c32f1680 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:20.049913 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc83eea-ed50-4253-9300-81c544bc3932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:20.050589 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc83eea-ed50-4253-9300-81c544bc3932 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:20.050863 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc83eea-ed50-4253-9300-81c544bc3932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:20.051134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc83eea-ed50-4253-9300-81c544bc3932 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:20.051869 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc83eea-ed50-4253-9300-81c544bc3932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:20.053433 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc83eea-ed50-4253-9300-81c544bc3932 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:20.064065 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1394/2844] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:10:20.068195 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e01ba-b7d9-4e3e-b69d-918006a0fe1a admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:20.077850 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e01ba-b7d9-4e3e-b69d-918006a0fe1a admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:20.082474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff177324-cf0b-4bad-8a8d-16bca563bb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:20.083118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff177324-cf0b-4bad-8a8d-16bca563bb54 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:20.083394 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff177324-cf0b-4bad-8a8d-16bca563bb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:20.083665 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff177324-cf0b-4bad-8a8d-16bca563bb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:20.084378 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff177324-cf0b-4bad-8a8d-16bca563bb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:20.085940 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff177324-cf0b-4bad-8a8d-16bca563bb54 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:20.095495 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1451/2845] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 28 22:10:20.099356 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc83eea-ed50-4253-9300-81c544bc3932 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:20.110135 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc83eea-ed50-4253-9300-81c544bc3932 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:20.114667 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef2d75-9c27-4dd5-b0ca-8e16e38cedb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:20.115522 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2d75-9c27-4dd5-b0ca-8e16e38cedb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:20.115792 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2d75-9c27-4dd5-b0ca-8e16e38cedb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:20.116060 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2d75-9c27-4dd5-b0ca-8e16e38cedb9 admin admin] PATH_INFO: `/v3/projects/f31bed594830435a8fa303555757a8c3/users/3eded21ddf8b42269d0d1fbd353ab86e/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:20.130568 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef2d75-9c27-4dd5-b0ca-8e16e38cedb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31bed594830435a8fa303555757a8c3, user_id=3eded21ddf8b42269d0d1fbd353ab86e, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:20.133207 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef2d75-9c27-4dd5-b0ca-8e16e38cedb9 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:20.205581 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1395/2846] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:10:20 2022] PUT /identity/v3/projects/f31bed594830435a8fa303555757a8c3/users/3eded21ddf8b42269d0d1fbd353ab86e/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:10:20.210708 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8fef-c75e-4b2c-b7b6-60d1f4bb4c7c None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:20.210998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8fef-c75e-4b2c-b7b6-60d1f4bb4c7c None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:20.211276 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f8fef-c75e-4b2c-b7b6-60d1f4bb4c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:20.229821 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-fe6f8fef-c75e-4b2c-b7b6-60d1f4bb4c7c None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:10:20.230502 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-fe6f8fef-c75e-4b2c-b7b6-60d1f4bb4c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:20.286343 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1452/2847] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:10:20.296381 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef2d75-9c27-4dd5-b0ca-8e16e38cedb9 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:20.298229 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ebef2d75-9c27-4dd5-b0ca-8e16e38cedb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:20.354835 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef2d75-9c27-4dd5-b0ca-8e16e38cedb9 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:20.358603 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193bd50-4a68-4025-a35a-63ffe5dca285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:20.359244 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193bd50-4a68-4025-a35a-63ffe5dca285 service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:20.359525 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193bd50-4a68-4025-a35a-63ffe5dca285 service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:20.359799 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193bd50-4a68-4025-a35a-63ffe5dca285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:20.369125 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193bd50-4a68-4025-a35a-63ffe5dca285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:20.370614 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193bd50-4a68-4025-a35a-63ffe5dca285 service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:20.380186 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1396/2848] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:10:21.591672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7120-a161-4e9a-9144-95a426369100 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:21.591672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7120-a161-4e9a-9144-95a426369100 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:21.591672 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7120-a161-4e9a-9144-95a426369100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:21.618632 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-5a7e7120-a161-4e9a-9144-95a426369100 None None] MFA Rules not processed for user `3eded21ddf8b42269d0d1fbd353ab86e`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:10:21.620267 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-5a7e7120-a161-4e9a-9144-95a426369100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:21.683080 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1453/2849] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:10:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:10:21.693763 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193bd50-4a68-4025-a35a-63ffe5dca285 service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:10:21.695162 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-6193bd50-4a68-4025-a35a-63ffe5dca285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:21.752593 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193bd50-4a68-4025-a35a-63ffe5dca285 service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:10:21.756134 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c990c-e689-4cd9-99a6-7196f5f34b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:10:21.756770 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c990c-e689-4cd9-99a6-7196f5f34b3a service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:21.757051 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c990c-e689-4cd9-99a6-7196f5f34b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:21.757323 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c990c-e689-4cd9-99a6-7196f5f34b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:21.766556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c990c-e689-4cd9-99a6-7196f5f34b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:10:21.768007 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c990c-e689-4cd9-99a6-7196f5f34b3a service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:10:21.777280 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1397/2850] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:10:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:10:23.525406 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8550653-c025-48a5-9cf6-381fdfa6bbd8 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:10:23.525937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8550653-c025-48a5-9cf6-381fdfa6bbd8 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:10:23.525937 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8550653-c025-48a5-9cf6-381fdfa6bbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:10:23.543824 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-e8550653-c025-48a5-9cf6-381fdfa6bbd8 None None] MFA Rules not processed for user `3eded21ddf8b42269d0d1fbd353ab86e`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:10:23.545015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e8550653-c025-48a5-9cf6-381fdfa6bbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:10:23.551967 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1454/2851] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:10:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:11:27.347940 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c990c-e689-4cd9-99a6-7196f5f34b3a service cinder] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:11:27.349347 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-658c990c-e689-4cd9-99a6-7196f5f34b3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:11:27.360929 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c990c-e689-4cd9-99a6-7196f5f34b3a service cinder] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:11:27.364489 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927d1a2-53f6-422f-a1c9-f7737d772863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8e7d47becf4c03967848eda8c311be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:11:27.365110 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d1a2-53f6-422f-a1c9-f7737d772863 service cinder] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:11:27.365384 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d1a2-53f6-422f-a1c9-f7737d772863 service cinder] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:11:27.365653 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d1a2-53f6-422f-a1c9-f7737d772863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:11:27.367396 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-3927d1a2-53f6-422f-a1c9-f7737d772863 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:11:27.447104 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927d1a2-53f6-422f-a1c9-f7737d772863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:11:27.448457 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927d1a2-53f6-422f-a1c9-f7737d772863 service cinder] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:11:27.468678 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1398/2852] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:11:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:11:30.396559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8550653-c025-48a5-9cf6-381fdfa6bbd8 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:11:30.398067 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e8550653-c025-48a5-9cf6-381fdfa6bbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:11:30.410862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8550653-c025-48a5-9cf6-381fdfa6bbd8 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:11:30.414472 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35190343-c1d4-4acf-89f0-71eadf5500bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:11:30.415106 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35190343-c1d4-4acf-89f0-71eadf5500bf service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:11:30.415389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35190343-c1d4-4acf-89f0-71eadf5500bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:11:30.415690 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35190343-c1d4-4acf-89f0-71eadf5500bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:11:30.417423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-35190343-c1d4-4acf-89f0-71eadf5500bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:11:30.431248 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35190343-c1d4-4acf-89f0-71eadf5500bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:11:30.432703 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35190343-c1d4-4acf-89f0-71eadf5500bf service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:11:30.444572 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1455/2853] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:11:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:11:42.960666 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237291f-d1dc-4726-bdda-8d1dae360844 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:11:42.961163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237291f-d1dc-4726-bdda-8d1dae360844 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:11:42.961271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237291f-d1dc-4726-bdda-8d1dae360844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:11:42.977754 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-8237291f-d1dc-4726-bdda-8d1dae360844 None None] MFA Rules not processed for user `3eded21ddf8b42269d0d1fbd353ab86e`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:11:42.978987 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-8237291f-d1dc-4726-bdda-8d1dae360844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:11:42.986252 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1399/2854] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:11:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:11:53.019815 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35190343-c1d4-4acf-89f0-71eadf5500bf service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:11:53.028538 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35190343-c1d4-4acf-89f0-71eadf5500bf service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:11:53.032292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc12c6f-7489-450f-90fd-6e521b585877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:11:53.033007 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc12c6f-7489-450f-90fd-6e521b585877 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:11:53.033284 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc12c6f-7489-450f-90fd-6e521b585877 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:11:53.033559 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc12c6f-7489-450f-90fd-6e521b585877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:11:53.035339 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-2cc12c6f-7489-450f-90fd-6e521b585877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:11:53.044621 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc12c6f-7489-450f-90fd-6e521b585877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:11:53.046055 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc12c6f-7489-450f-90fd-6e521b585877 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:11:53.053805 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1456/2855] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:11:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:12:51.106301 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237291f-d1dc-4726-bdda-8d1dae360844 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:51.117626 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237291f-d1dc-4726-bdda-8d1dae360844 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:51.122293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:51.123157 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:51.123487 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:51.123807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] PATH_INFO: `/v3/users/3eded21ddf8b42269d0d1fbd353ab86e` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:51.124911 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eded21ddf8b42269d0d1fbd353ab86e)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:51.126865 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:51.271893 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eded21ddf8b42269d0d1fbd353ab86e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:12:51.272540 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eded21ddf8b42269d0d1fbd353ab86e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:12:51.333083 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eded21ddf8b42269d0d1fbd353ab86e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:12:51.339807 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eded21ddf8b42269d0d1fbd353ab86e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:12:51.352190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-2902260b-ff19-4e73-8e6f-1bb7c97c0312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eded21ddf8b42269d0d1fbd353ab86e'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:12:51.357858 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1400/2856] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:12:51 2022] DELETE /identity/v3/users/3eded21ddf8b42269d0d1fbd353ab86e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:12:51.581192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc12c6f-7489-450f-90fd-6e521b585877 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:51.594858 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc12c6f-7489-450f-90fd-6e521b585877 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:51.653362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:51.654252 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:51.654534 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:51.654953 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] PATH_INFO: `/v3/projects/f31bed594830435a8fa303555757a8c3` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:51.656128 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31bed594830435a8fa303555757a8c3)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:51.658015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:51.754357 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31bed594830435a8fa303555757a8c3', 'request_id': 'req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:12:51.761118 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31bed594830435a8fa303555757a8c3', 'request_id': 'req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:12:51.847057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31bed594830435a8fa303555757a8c3', 'request_id': 'req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:12:51.858505 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] The token cache is being invalidate because project f31bed594830435a8fa303555757a8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:12:51.858798 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:12:51.859449 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-b865ffb8-b0ca-4f3b-9e34-9f3677f5f517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:12:51.861057 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1457/2857] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:12:51 2022] DELETE /identity/v3/projects/f31bed594830435a8fa303555757a8c3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:12:51.866632 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8e69-736e-481a-a0eb-c2203ea4157f None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:51.878345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8e69-736e-481a-a0eb-c2203ea4157f None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:51.878345 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8e69-736e-481a-a0eb-c2203ea4157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:51.886271 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-5e7a8e69-736e-481a-a0eb-c2203ea4157f None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:12:51.887476 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5e7a8e69-736e-481a-a0eb-c2203ea4157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:12:51.944331 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1401/2858] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:12:51.951884 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1aa40-463e-4f87-b7eb-f0d498b0db91 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:51.952169 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1aa40-463e-4f87-b7eb-f0d498b0db91 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:51.952439 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1aa40-463e-4f87-b7eb-f0d498b0db91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:51.972371 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-cdf1aa40-463e-4f87-b7eb-f0d498b0db91 None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:12:51.973730 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-cdf1aa40-463e-4f87-b7eb-f0d498b0db91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:12:51.981714 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1458/2859] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:12:51.985748 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8e69-736e-481a-a0eb-c2203ea4157f None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:51.995166 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8e69-736e-481a-a0eb-c2203ea4157f None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:51.999682 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d01e7-53be-4803-bd43-dc712e72a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:52.000316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d01e7-53be-4803-bd43-dc712e72a74c admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:52.000590 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d01e7-53be-4803-bd43-dc712e72a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:52.000855 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d01e7-53be-4803-bd43-dc712e72a74c admin admin] PATH_INFO: `/v3/domains` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:52.001562 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d01e7-53be-4803-bd43-dc712e72a74c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 28 22:12:52.001857 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d01e7-53be-4803-bd43-dc712e72a74c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:52.003465 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d01e7-53be-4803-bd43-dc712e72a74c admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:52.015098 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1402/2860] 10.222.0.26 () {58 vars in 1152 bytes} [Mon Feb 28 22:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 28 22:12:52.018888 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1aa40-463e-4f87-b7eb-f0d498b0db91 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:52.028222 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1aa40-463e-4f87-b7eb-f0d498b0db91 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:52.033026 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d831-a48b-4d56-80c1-308138b4ff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:52.033670 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d831-a48b-4d56-80c1-308138b4ff41 admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:52.033951 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d831-a48b-4d56-80c1-308138b4ff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:52.034254 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78d831-a48b-4d56-80c1-308138b4ff41 admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:52.034942 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78d831-a48b-4d56-80c1-308138b4ff41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:52.036984 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78d831-a48b-4d56-80c1-308138b4ff41 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:52.117192 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1459/2861] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:12:52 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:12:52.121249 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d01e7-53be-4803-bd43-dc712e72a74c admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:52.131927 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d01e7-53be-4803-bd43-dc712e72a74c admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:52.187612 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c624-8fd3-42f4-a485-85e9c3aef851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:52.188336 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c624-8fd3-42f4-a485-85e9c3aef851 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:52.188637 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c624-8fd3-42f4-a485-85e9c3aef851 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:52.188916 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c624-8fd3-42f4-a485-85e9c3aef851 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:52.189609 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1c624-8fd3-42f4-a485-85e9c3aef851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:52.191556 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1c624-8fd3-42f4-a485-85e9c3aef851 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:52.292962 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1403/2862] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:12:52 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 28 22:12:52.297034 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d831-a48b-4d56-80c1-308138b4ff41 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:52.307739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78d831-a48b-4d56-80c1-308138b4ff41 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:52.312693 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a3109-2f82-4d98-b80d-ba5ef7551aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:52.313336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a3109-2f82-4d98-b80d-ba5ef7551aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:52.313776 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a3109-2f82-4d98-b80d-ba5ef7551aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:52.314076 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a3109-2f82-4d98-b80d-ba5ef7551aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:52.314874 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a3109-2f82-4d98-b80d-ba5ef7551aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:52.316475 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a3109-2f82-4d98-b80d-ba5ef7551aa9 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:52.327082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1460/2863] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:12:52.331147 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c624-8fd3-42f4-a485-85e9c3aef851 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:52.341621 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c624-8fd3-42f4-a485-85e9c3aef851 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:52.346325 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3744bc1-bbd5-4150-a74f-332969116554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:52.346971 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744bc1-bbd5-4150-a74f-332969116554 admin admin] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:52.347254 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744bc1-bbd5-4150-a74f-332969116554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:52.347530 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3744bc1-bbd5-4150-a74f-332969116554 admin admin] PATH_INFO: `/v3/roles` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:52.348270 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3744bc1-bbd5-4150-a74f-332969116554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:52.350376 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3744bc1-bbd5-4150-a74f-332969116554 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:52.360221 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1404/2864] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:12:52.366413 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a3109-2f82-4d98-b80d-ba5ef7551aa9 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:52.376477 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a3109-2f82-4d98-b80d-ba5ef7551aa9 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:52.381847 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8360fa8-4b34-42f3-82d9-b6095496aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:52.385862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8360fa8-4b34-42f3-82d9-b6095496aa1d admin admin] REQUEST_METHOD: `PUT` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:52.385862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8360fa8-4b34-42f3-82d9-b6095496aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:52.385862 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8360fa8-4b34-42f3-82d9-b6095496aa1d admin admin] PATH_INFO: `/v3/projects/a3e5fe453d5a4aa48cac1f4d0e3401bf/users/a33eb78e595b412dbeb64ab8df412282/roles/b15932e4d63b437eb478fd41d0ae6ec6` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:52.397446 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8360fa8-4b34-42f3-82d9-b6095496aa1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e5fe453d5a4aa48cac1f4d0e3401bf, user_id=a33eb78e595b412dbeb64ab8df412282, role_id=b15932e4d63b437eb478fd41d0ae6ec6)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:52.400339 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8360fa8-4b34-42f3-82d9-b6095496aa1d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:52.464577 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1461/2865] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:12:52 2022] PUT /identity/v3/projects/a3e5fe453d5a4aa48cac1f4d0e3401bf/users/a33eb78e595b412dbeb64ab8df412282/roles/b15932e4d63b437eb478fd41d0ae6ec6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:12:52.469710 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a69285-81b3-472a-add5-dcc25392dc4b None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:52.470018 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a69285-81b3-472a-add5-dcc25392dc4b None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:52.470414 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a69285-81b3-472a-add5-dcc25392dc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:52.488000 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-63a69285-81b3-472a-add5-dcc25392dc4b None None] MFA Rules not processed for user `3a718f2072b24450a97264ccf1958236`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:12:52.489697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-63a69285-81b3-472a-add5-dcc25392dc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:12:52.544785 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1405/2866] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 28 22:12:52.554900 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8360fa8-4b34-42f3-82d9-b6095496aa1d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:52.556581 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-d8360fa8-4b34-42f3-82d9-b6095496aa1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:12:52.610155 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8360fa8-4b34-42f3-82d9-b6095496aa1d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:52.613792 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bd3a5-a90e-4710-8e1a-19615829f1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:52.615160 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bd3a5-a90e-4710-8e1a-19615829f1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:52.615444 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bd3a5-a90e-4710-8e1a-19615829f1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:52.615723 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bd3a5-a90e-4710-8e1a-19615829f1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:52.624440 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bd3a5-a90e-4710-8e1a-19615829f1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:52.625837 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bd3a5-a90e-4710-8e1a-19615829f1c5 service neutron] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:52.635225 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1462/2867] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:12:57.707021 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcc5ef-97d8-4bf8-aee8-7d98cd2a7c76 None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:57.707543 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcc5ef-97d8-4bf8-aee8-7d98cd2a7c76 None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:57.707848 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcc5ef-97d8-4bf8-aee8-7d98cd2a7c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:57.737439 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-17fcc5ef-97d8-4bf8-aee8-7d98cd2a7c76 None None] MFA Rules not processed for user `a33eb78e595b412dbeb64ab8df412282`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:12:57.739298 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-17fcc5ef-97d8-4bf8-aee8-7d98cd2a7c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:12:57.823226 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1406/2868] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:12:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:12:57.827281 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bd3a5-a90e-4710-8e1a-19615829f1c5 service neutron] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:57.837616 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bd3a5-a90e-4710-8e1a-19615829f1c5 service neutron] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:57.842180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729d88c-6036-4883-a271-7a37d2cf5d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:57.843033 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729d88c-6036-4883-a271-7a37d2cf5d6d admin admin] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:57.843386 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729d88c-6036-4883-a271-7a37d2cf5d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:57.843564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729d88c-6036-4883-a271-7a37d2cf5d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:57.844257 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729d88c-6036-4883-a271-7a37d2cf5d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:57.846185 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729d88c-6036-4883-a271-7a37d2cf5d6d admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:57.951771 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1463/2869] 10.222.0.26 () {60 vars in 1152 bytes} [Mon Feb 28 22:12:57 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:12:57.956190 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcc5ef-97d8-4bf8-aee8-7d98cd2a7c76 None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:57.968290 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcc5ef-97d8-4bf8-aee8-7d98cd2a7c76 None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:58.027747 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e07003-5b42-4afd-8b10-7b517666b903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:58.028438 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07003-5b42-4afd-8b10-7b517666b903 admin admin] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:58.028720 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07003-5b42-4afd-8b10-7b517666b903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:58.029027 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e07003-5b42-4afd-8b10-7b517666b903 admin admin] PATH_INFO: `/v3/users` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:58.029741 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e07003-5b42-4afd-8b10-7b517666b903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:58.031716 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e07003-5b42-4afd-8b10-7b517666b903 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:58.156132 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1407/2870] 10.222.0.26 () {60 vars in 1143 bytes} [Mon Feb 28 22:12:57 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 28 22:12:58.161389 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729d88c-6036-4883-a271-7a37d2cf5d6d admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:58.171131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729d88c-6036-4883-a271-7a37d2cf5d6d admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:58.176421 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdef98-8585-4b39-b3b4-153ad9cc812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:58.177150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdef98-8585-4b39-b3b4-153ad9cc812b admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:58.177458 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdef98-8585-4b39-b3b4-153ad9cc812b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:58.177732 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdef98-8585-4b39-b3b4-153ad9cc812b admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:58.178508 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdef98-8585-4b39-b3b4-153ad9cc812b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:58.180200 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdef98-8585-4b39-b3b4-153ad9cc812b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:58.191468 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1464/2871] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:12:58.195779 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e07003-5b42-4afd-8b10-7b517666b903 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:58.206056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e07003-5b42-4afd-8b10-7b517666b903 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:58.211327 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f66e0d-e170-49b8-af59-83e0313748f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:58.212357 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f66e0d-e170-49b8-af59-83e0313748f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:58.212711 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f66e0d-e170-49b8-af59-83e0313748f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:58.213050 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f66e0d-e170-49b8-af59-83e0313748f8 admin admin] PATH_INFO: `/v3/projects/cc539af8abed4391a915a0258c723274/users/41ec68d4bed84b5da16c5b723128cfcb/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:58.230195 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f66e0d-e170-49b8-af59-83e0313748f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc539af8abed4391a915a0258c723274, user_id=41ec68d4bed84b5da16c5b723128cfcb, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:58.232864 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f66e0d-e170-49b8-af59-83e0313748f8 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:58.327837 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1408/2872] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:12:58 2022] PUT /identity/v3/projects/cc539af8abed4391a915a0258c723274/users/41ec68d4bed84b5da16c5b723128cfcb/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:12:58.331728 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdef98-8585-4b39-b3b4-153ad9cc812b admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:58.344064 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdef98-8585-4b39-b3b4-153ad9cc812b admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:58.404111 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f7a91-55ca-4395-954c-ec72dc0d440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:58.404787 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f7a91-55ca-4395-954c-ec72dc0d440b admin admin] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:58.405065 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f7a91-55ca-4395-954c-ec72dc0d440b admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:58.405336 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f7a91-55ca-4395-954c-ec72dc0d440b admin admin] PATH_INFO: `/v3/roles` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:58.406088 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f7a91-55ca-4395-954c-ec72dc0d440b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:58.407663 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f7a91-55ca-4395-954c-ec72dc0d440b admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:58.420642 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1465/2873] 10.222.0.26 () {58 vars in 1121 bytes} [Mon Feb 28 22:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 28 22:12:58.424958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f66e0d-e170-49b8-af59-83e0313748f8 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:12:58.435958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f66e0d-e170-49b8-af59-83e0313748f8 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:12:58.452462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76fb2-f038-4a2e-8709-8685ff2ddf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:12:58.452462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76fb2-f038-4a2e-8709-8685ff2ddf43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:12:58.452462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76fb2-f038-4a2e-8709-8685ff2ddf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:12:58.452462 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76fb2-f038-4a2e-8709-8685ff2ddf43 admin admin] PATH_INFO: `/v3/projects/cc539af8abed4391a915a0258c723274/users/41ec68d4bed84b5da16c5b723128cfcb/roles/b3b7af4521ad4bff9d33a92f132b3598` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:12:58.453048 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d76fb2-f038-4a2e-8709-8685ff2ddf43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc539af8abed4391a915a0258c723274, user_id=41ec68d4bed84b5da16c5b723128cfcb, role_id=b3b7af4521ad4bff9d33a92f132b3598)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:12:58.453048 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d76fb2-f038-4a2e-8709-8685ff2ddf43 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:12:58.460132 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1409/2874] 10.222.0.26 () {60 vars in 1482 bytes} [Mon Feb 28 22:12:58 2022] PUT /identity/v3/projects/cc539af8abed4391a915a0258c723274/users/41ec68d4bed84b5da16c5b723128cfcb/roles/b3b7af4521ad4bff9d33a92f132b3598 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:13:04.046838 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1982-c7da-4776-a48f-386360efc24a None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:04.047332 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1982-c7da-4776-a48f-386360efc24a None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:04.047430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1982-c7da-4776-a48f-386360efc24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:04.087414 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-ba2e1982-c7da-4776-a48f-386360efc24a None None] MFA Rules not processed for user `41ec68d4bed84b5da16c5b723128cfcb`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:13:04.088667 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-ba2e1982-c7da-4776-a48f-386360efc24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:04.164474 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1466/2875] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:13:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:13:04.181038 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76fb2-f038-4a2e-8709-8685ff2ddf43 admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:13:04.183031 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-f5d76fb2-f038-4a2e-8709-8685ff2ddf43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:04.268315 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76fb2-f038-4a2e-8709-8685ff2ddf43 admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:13:04.273627 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee260951-41a4-4a5b-bff5-254dbc89e7c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '500eaf6aadff441ca1e535443e1d8c03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:13:04.274318 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee260951-41a4-4a5b-bff5-254dbc89e7c6 service glance] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:04.274597 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee260951-41a4-4a5b-bff5-254dbc89e7c6 service glance] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:04.274884 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee260951-41a4-4a5b-bff5-254dbc89e7c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:04.340005 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee260951-41a4-4a5b-bff5-254dbc89e7c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:13:04.341882 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee260951-41a4-4a5b-bff5-254dbc89e7c6 service glance] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:13:04.353407 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1410/2876] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:13:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:13:04.633019 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6391-345a-4025-bc68-5a2adc2a0b06 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:04.633603 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6391-345a-4025-bc68-5a2adc2a0b06 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:04.633943 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6391-345a-4025-bc68-5a2adc2a0b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:04.652641 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-80ed6391-345a-4025-bc68-5a2adc2a0b06 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:13:04.653843 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-80ed6391-345a-4025-bc68-5a2adc2a0b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:04.711727 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1467/2877] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 22:13:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:13:04.908523 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee260951-41a4-4a5b-bff5-254dbc89e7c6 service glance] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:13:04.909959 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-ee260951-41a4-4a5b-bff5-254dbc89e7c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:04.981042 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee260951-41a4-4a5b-bff5-254dbc89e7c6 service glance] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:13:04.986069 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3664b-7ac8-471e-a9a6-25cb37c2d5da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:13:04.986721 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3664b-7ac8-471e-a9a6-25cb37c2d5da service swift] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:04.986998 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3664b-7ac8-471e-a9a6-25cb37c2d5da service swift] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:04.987269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3664b-7ac8-471e-a9a6-25cb37c2d5da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:04.998583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3664b-7ac8-471e-a9a6-25cb37c2d5da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:13:05.000191 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3664b-7ac8-471e-a9a6-25cb37c2d5da service swift] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:13:05.009441 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1411/2878] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:13:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:13:14.853822 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198615ab-bc67-4736-bb86-cf2a8b601b05 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:14.854359 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198615ab-bc67-4736-bb86-cf2a8b601b05 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:14.854459 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198615ab-bc67-4736-bb86-cf2a8b601b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:14.873099 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-198615ab-bc67-4736-bb86-cf2a8b601b05 None None] MFA Rules not processed for user `a33eb78e595b412dbeb64ab8df412282`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:13:14.874369 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-198615ab-bc67-4736-bb86-cf2a8b601b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:14.881965 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1468/2879] 10.222.0.26 () {58 vars in 957 bytes} [Mon Feb 28 22:13:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:13:15.135086 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3664b-7ac8-471e-a9a6-25cb37c2d5da service swift] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:13:15.142245 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-5bc3664b-7ac8-471e-a9a6-25cb37c2d5da service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:15.194899 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3664b-7ac8-471e-a9a6-25cb37c2d5da service swift] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:13:15.198493 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66dafd8-9288-4e67-9784-f027031054de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:13:15.199130 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dafd8-9288-4e67-9784-f027031054de service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:15.199410 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dafd8-9288-4e67-9784-f027031054de service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:15.199685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66dafd8-9288-4e67-9784-f027031054de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:15.201454 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c66dafd8-9288-4e67-9784-f027031054de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:15.210851 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dafd8-9288-4e67-9784-f027031054de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:13:15.212269 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66dafd8-9288-4e67-9784-f027031054de service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:13:15.220003 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1412/2880] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:13:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:13:15.702150 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198615ab-bc67-4736-bb86-cf2a8b601b05 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:13:15.703961 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-198615ab-bc67-4736-bb86-cf2a8b601b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:15.792059 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198615ab-bc67-4736-bb86-cf2a8b601b05 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:13:15.797015 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93039c32-9ee2-40f2-822b-949eaa43e668 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1875af7b72b247c9a2b5e1f2b2fb1eaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:13:15.797647 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039c32-9ee2-40f2-822b-949eaa43e668 service placement] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:15.798237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039c32-9ee2-40f2-822b-949eaa43e668 service placement] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:15.798237 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039c32-9ee2-40f2-822b-949eaa43e668 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:15.799964 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-93039c32-9ee2-40f2-822b-949eaa43e668 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:15.813788 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93039c32-9ee2-40f2-822b-949eaa43e668 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:13:15.815430 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93039c32-9ee2-40f2-822b-949eaa43e668 service placement] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:13:15.827688 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1469/2881] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:13:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:13:18.305362 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef060-95a4-40e2-934e-8e629024cafa None None] REQUEST_METHOD: `POST` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:18.305854 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef060-95a4-40e2-934e-8e629024cafa None None] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:18.305972 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef060-95a4-40e2-934e-8e629024cafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:18.323827 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.auth.core [None req-775ef060-95a4-40e2-934e-8e629024cafa None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:13:18.325029 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-775ef060-95a4-40e2-934e-8e629024cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:18.333138 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1413/2882] 10.222.0.26 () {58 vars in 1009 bytes} [Mon Feb 28 22:13:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:13:18.346211 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93039c32-9ee2-40f2-822b-949eaa43e668 service placement] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:13:18.357137 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93039c32-9ee2-40f2-822b-949eaa43e668 service placement] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:13:18.362040 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eace9-279b-473b-98fb-a1db05afdba3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:13:18.363182 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eace9-279b-473b-98fb-a1db05afdba3 service swift] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:18.363469 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eace9-279b-473b-98fb-a1db05afdba3 service swift] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:18.363733 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eace9-279b-473b-98fb-a1db05afdba3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:18.371931 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5eace9-279b-473b-98fb-a1db05afdba3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:13:18.373513 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5eace9-279b-473b-98fb-a1db05afdba3 service swift] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:13:18.382303 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1470/2883] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:13:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:13:29.391691 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ef060-95a4-40e2-934e-8e629024cafa None None] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:13:29.402299 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-775ef060-95a4-40e2-934e-8e629024cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:29.480632 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ef060-95a4-40e2-934e-8e629024cafa None None] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:13:29.487131 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515488-ba5c-459c-be04-ee71d8a03ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:13:29.488109 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515488-ba5c-459c-be04-ee71d8a03ff2 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:29.488595 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515488-ba5c-459c-be04-ee71d8a03ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:29.489607 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21515488-ba5c-459c-be04-ee71d8a03ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:29.491119 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-21515488-ba5c-459c-be04-ee71d8a03ff2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:29.505350 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21515488-ba5c-459c-be04-ee71d8a03ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:13:29.507432 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21515488-ba5c-459c-be04-ee71d8a03ff2 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:13:29.521679 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1414/2884] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:13:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:13:35.102402 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eace9-279b-473b-98fb-a1db05afdba3 service swift] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:13:35.115548 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eace9-279b-473b-98fb-a1db05afdba3 service swift] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:13:35.120873 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c12dc-cf3f-4a61-83ca-8ea16f038744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:13:35.121974 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c12dc-cf3f-4a61-83ca-8ea16f038744 service nova] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:35.122287 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c12dc-cf3f-4a61-83ca-8ea16f038744 service nova] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:35.122564 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c12dc-cf3f-4a61-83ca-8ea16f038744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:35.124353 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-df3c12dc-cf3f-4a61-83ca-8ea16f038744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:13:35.137110 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c12dc-cf3f-4a61-83ca-8ea16f038744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:13:35.138753 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c12dc-cf3f-4a61-83ca-8ea16f038744 service nova] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:13:35.149955 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1471/2885] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:13:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 28 22:13:48.853958 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515488-ba5c-459c-be04-ee71d8a03ff2 service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:13:48.863158 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21515488-ba5c-459c-be04-ee71d8a03ff2 service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:13:48.867594 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad388-e832-4657-ad08-2a0ed67ce25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4664710493b462bafae3908c582e9bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:13:48.868225 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad388-e832-4657-ad08-2a0ed67ce25d service neutron] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:13:48.868517 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad388-e832-4657-ad08-2a0ed67ce25d service neutron] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:13:48.868777 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad388-e832-4657-ad08-2a0ed67ce25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:13:48.877983 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ad388-e832-4657-ad08-2a0ed67ce25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:13:48.879484 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ad388-e832-4657-ad08-2a0ed67ce25d service neutron] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:13:48.888726 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1415/2886] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:13:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:14:27.769998 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c12dc-cf3f-4a61-83ca-8ea16f038744 service nova] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:14:27.771432 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-df3c12dc-cf3f-4a61-83ca-8ea16f038744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:14:27.786135 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c12dc-cf3f-4a61-83ca-8ea16f038744 service nova] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:14:27.792255 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5ef0f-0af1-45a0-9ead-f7d2ac560c2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1875af7b72b247c9a2b5e1f2b2fb1eaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:14:27.792883 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5ef0f-0af1-45a0-9ead-f7d2ac560c2d service placement] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:14:27.793165 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5ef0f-0af1-45a0-9ead-f7d2ac560c2d service placement] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:14:27.793440 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5ef0f-0af1-45a0-9ead-f7d2ac560c2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:14:27.795167 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-41f5ef0f-0af1-45a0-9ead-f7d2ac560c2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:14:27.806774 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5ef0f-0af1-45a0-9ead-f7d2ac560c2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:14:27.808597 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5ef0f-0af1-45a0-9ead-f7d2ac560c2d service placement] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:14:27.818344 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1472/2887] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:14:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:16:09.010408 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad388-e832-4657-ad08-2a0ed67ce25d service neutron] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:16:09.025447 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad388-e832-4657-ad08-2a0ed67ce25d service neutron] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:16:09.034011 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb4b9e-176b-4d97-910c-c666835ab769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8182c282a5754f05b4bb6bb7057fa7ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:16:09.034326 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb4b9e-176b-4d97-910c-c666835ab769 service nova] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:16:09.034554 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb4b9e-176b-4d97-910c-c666835ab769 service nova] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:16:09.034826 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb4b9e-176b-4d97-910c-c666835ab769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:16:09.036845 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-81fb4b9e-176b-4d97-910c-c666835ab769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:16:09.049616 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb4b9e-176b-4d97-910c-c666835ab769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:16:09.051442 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb4b9e-176b-4d97-910c-c666835ab769 service nova] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:16:09.063044 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1416/2888] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:16:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 28 22:16:15.809352 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4de4a-e304-45bf-a3a7-73b71816afe3 None None] REQUEST_METHOD: `POST` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:16:15.809808 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4de4a-e304-45bf-a3a7-73b71816afe3 None None] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:16:15.809910 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4de4a-e304-45bf-a3a7-73b71816afe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:16:15.828292 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.auth.core [None req-46f4de4a-e304-45bf-a3a7-73b71816afe3 None None] MFA Rules not processed for user `3e0f83cdc2d54ced991c979f9de554a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 28 22:16:15.829467 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-46f4de4a-e304-45bf-a3a7-73b71816afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:16:15.836501 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1473/2889] 10.222.0.26 () {58 vars in 967 bytes} [Mon Feb 28 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 28 22:16:15.876400 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb4b9e-176b-4d97-910c-c666835ab769 service nova] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:16:15.888068 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb4b9e-176b-4d97-910c-c666835ab769 service nova] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:16:15.892950 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f192ed-8787-4ec5-b148-18d149a4c334 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '368937ee42184e31b346ab9db570c122', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:16:15.893574 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f192ed-8787-4ec5-b148-18d149a4c334 service swift] REQUEST_METHOD: `GET` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:16:15.893848 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f192ed-8787-4ec5-b148-18d149a4c334 service swift] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:16:15.894163 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f192ed-8787-4ec5-b148-18d149a4c334 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:16:15.902936 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f192ed-8787-4ec5-b148-18d149a4c334 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:16:15.904446 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f192ed-8787-4ec5-b148-18d149a4c334 service swift] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:16:15.912421 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1417/2890] 10.222.0.26 () {60 vars in 1384 bytes} [Mon Feb 28 22:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 28 22:16:24.179891 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4de4a-e304-45bf-a3a7-73b71816afe3 None None] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:16:24.247361 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4de4a-e304-45bf-a3a7-73b71816afe3 None None] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:16:24.252290 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:16:24.253180 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:16:24.253463 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:16:24.253734 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] PATH_INFO: `/v3/users/a33eb78e595b412dbeb64ab8df412282` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:16:24.254997 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33eb78e595b412dbeb64ab8df412282)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:16:24.256960 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:16:24.467739 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33eb78e595b412dbeb64ab8df412282'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:24.474576 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33eb78e595b412dbeb64ab8df412282'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:24.563131 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33eb78e595b412dbeb64ab8df412282'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:24.575490 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33eb78e595b412dbeb64ab8df412282'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:24.594423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33eb78e595b412dbeb64ab8df412282'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:24.594423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1474/2891] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:16:24 2022] DELETE /identity/v3/users/a33eb78e595b412dbeb64ab8df412282 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:16:24.810663 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f192ed-8787-4ec5-b148-18d149a4c334 service swift] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:16:24.821583 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f192ed-8787-4ec5-b148-18d149a4c334 service swift] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:16:24.878202 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:16:24.879056 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:16:24.879332 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:16:24.879601 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] PATH_INFO: `/v3/projects/a3e5fe453d5a4aa48cac1f4d0e3401bf` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:16:24.880759 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e5fe453d5a4aa48cac1f4d0e3401bf)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:16:24.882697 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:16:24.974058 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e5fe453d5a4aa48cac1f4d0e3401bf', 'request_id': 'req-c76bcec3-9c92-4772-aadb-e93a1f9308cd'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:24.980563 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e5fe453d5a4aa48cac1f4d0e3401bf', 'request_id': 'req-c76bcec3-9c92-4772-aadb-e93a1f9308cd'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:24.986087 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e5fe453d5a4aa48cac1f4d0e3401bf', 'request_id': 'req-c76bcec3-9c92-4772-aadb-e93a1f9308cd'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.059227 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] The token cache is being invalidate because project a3e5fe453d5a4aa48cac1f4d0e3401bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:16:25.059509 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.060148 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.061705 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1418/2892] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:16:24 2022] DELETE /identity/v3/projects/a3e5fe453d5a4aa48cac1f4d0e3401bf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:16:25.065689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:16:25.067114 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:16:25.080454 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5d912-493a-453e-ad55-147f6d95544c admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:16:25.134293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:16:25.135147 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:16:25.135422 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:16:25.135689 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] PATH_INFO: `/v3/users/41ec68d4bed84b5da16c5b723128cfcb` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:16:25.137362 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ec68d4bed84b5da16c5b723128cfcb)` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:16:25.139274 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:16:25.307179 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ec68d4bed84b5da16c5b723128cfcb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.314030 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ec68d4bed84b5da16c5b723128cfcb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.360959 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ec68d4bed84b5da16c5b723128cfcb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.372456 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ec68d4bed84b5da16c5b723128cfcb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.373082 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.notifications [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ec68d4bed84b5da16c5b723128cfcb'} {{(pid=86286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.378860 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1475/2893] 10.222.0.26 () {58 vars in 1223 bytes} [Mon Feb 28 22:16:25 2022] DELETE /identity/v3/users/41ec68d4bed84b5da16c5b723128cfcb => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 28 22:16:25.616012 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] Authenticating user token {{(pid=86285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:16:25.617477 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.fernet_utils [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:16:25.632511 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bcec3-9c92-4772-aadb-e93a1f9308cd admin admin] Validating token access rules against request {{(pid=86285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:16:25.687823 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a718f2072b24450a97264ccf1958236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7297e55969ab4bf0b026f4e20d2cae80', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:16:25.688669 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:16:25.688946 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:16:25.689223 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] PATH_INFO: `/v3/projects/cc539af8abed4391a915a0258c723274` {{(pid=86285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:16:25.690416 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc539af8abed4391a915a0258c723274)` {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:16:25.692316 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] RBAC: Authorization granted {{(pid=86285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:16:25.773505 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc539af8abed4391a915a0258c723274', 'request_id': 'req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.779699 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc539af8abed4391a915a0258c723274', 'request_id': 'req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.785024 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc539af8abed4391a915a0258c723274', 'request_id': 'req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21'} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.860293 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] The token cache is being invalidate because project cc539af8abed4391a915a0258c723274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 28 22:16:25.860820 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.861113 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: DEBUG keystone.notifications [None req-f8f76fc6-6d63-4f25-9bd1-ecec96c9ce21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 28 22:16:25.862685 dv-cinder-830901-2-iscsi devstack@keystone.service[86285]: [pid: 86285|app: 0|req: 1419/2894] 10.222.0.26 () {58 vars in 1232 bytes} [Mon Feb 28 22:16:25 2022] DELETE /identity/v3/projects/cc539af8abed4391a915a0258c723274 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 28 22:19:31.789140 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] Authenticating user token {{(pid=86286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 28 22:19:31.790526 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:19:31.926271 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38517f10-5497-423b-95ae-560b486c4b05 admin admin] Validating token access rules against request {{(pid=86286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 28 22:19:31.982227 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c052dec-7639-4890-afcd-9e7ff37d7a13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1875af7b72b247c9a2b5e1f2b2fb1eaa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6d5f76f1ecc444e90b82818ac55901b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 28 22:19:31.982864 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c052dec-7639-4890-afcd-9e7ff37d7a13 service placement] REQUEST_METHOD: `GET` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 28 22:19:31.983147 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c052dec-7639-4890-afcd-9e7ff37d7a13 service placement] SCRIPT_NAME: `/identity` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 28 22:19:31.983423 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c052dec-7639-4890-afcd-9e7ff37d7a13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 28 22:19:31.985178 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.fernet_utils [None req-3c052dec-7639-4890-afcd-9e7ff37d7a13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 28 22:19:31.996108 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c052dec-7639-4890-afcd-9e7ff37d7a13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 28 22:19:31.998293 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c052dec-7639-4890-afcd-9e7ff37d7a13 service placement] RBAC: Authorization granted {{(pid=86286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 28 22:19:32.007877 dv-cinder-830901-2-iscsi devstack@keystone.service[86286]: [pid: 86286|app: 0|req: 1476/2895] 10.222.0.26 () {60 vars in 1365 bytes} [Mon Feb 28 22:19:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)